Note: This is test shard 3 of 3.
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/2
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260620 14:47:31.570127 8059 test_util.cc:268] Using random seed: 2100328867
2026-06-20T14:47:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-20T14:47:31Z Disabled control of system clock
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-task9VKlbC/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-task9VKlbC/thirdparty/src/hadoop-3.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL: jdbc:derby:/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/metadb;create=true
Metastore Connection Driver : org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User: APP
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.derby.sql
Initialization script completed
schemaTool completed
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/security.properties
2026-06-20 14:47:38: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-task9VKlbC/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-task9VKlbC/thirdparty/src/hadoop-3.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Starting hive metastore on port 0
I20260620 14:47:45.445362 8059 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9VKlbC/build/asan/bin/kudu
/tmp/dist-test-task9VKlbC/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.222.254:39515
--webserver_interface=127.7.222.254
--webserver_port=0
--builtin_ntp_servers=127.7.222.212:42755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--hive_metastore_uris=thrift://127.0.0.1:42797
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260620 14:47:45.777899 8300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:47:45.778198 8300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:47:45.778276 8300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:47:45.785828 8300 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:47:45.785974 8300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:47:45.786020 8300 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:47:45.786069 8300 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:47:45.795243 8300 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.222.212:42755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:42797
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.222.254:39515
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.222.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 13:41:20 UTC on ccycloud.quasar-vdagoi.root.comops.site
build id 4457462
ASAN enabled
I20260620 14:47:45.796555 8300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:47:45.798287 8300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:47:45.811054 8308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:47:45.811146 8306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:47:45.811257 8300 server_base.cc:1034] running on GCE node
W20260620 14:47:45.811146 8305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:47:45.812460 8300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:47:45.813941 8300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:47:45.815224 8300 hybrid_clock.cc:648] HybridClock initialized: now 1781966865815132 us; error 68 us; skew 500 ppm
I20260620 14:47:45.815608 8300 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 14:47:45.818806 8300 webserver.cc:460] Webserver started at http://127.7.222.254:44159/ using document root <none> and password file <none>
I20260620 14:47:45.819531 8300 fs_manager.cc:359] Metadata directory not provided
I20260620 14:47:45.819692 8300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:47:45.820042 8300 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:47:45.822916 8300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/data/instance:
uuid: "dd308569015348a7a19ba4a560de6d52"
format_stamp: "Formatted at 2026-06-20 14:47:45 on dist-test-slave-c599"
I20260620 14:47:45.823752 8300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/wal/instance:
uuid: "dd308569015348a7a19ba4a560de6d52"
format_stamp: "Formatted at 2026-06-20 14:47:45 on dist-test-slave-c599"
I20260620 14:47:45.829516 8300 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260620 14:47:45.833045 8314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:47:45.834491 8300 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260620 14:47:45.834712 8300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/data,/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/wal
uuid: "dd308569015348a7a19ba4a560de6d52"
format_stamp: "Formatted at 2026-06-20 14:47:45 on dist-test-slave-c599"
I20260620 14:47:45.834915 8300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:47:45.856868 8300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:47:45.858114 8300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:47:45.858429 8300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:47:45.878469 8300 rpc_server.cc:307] RPC server started. Bound to: 127.7.222.254:39515
I20260620 14:47:45.878499 8365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.222.254:39515 every 8 connection(s)
I20260620 14:47:45.879909 8300 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/data/info.pb
I20260620 14:47:45.883852 8059 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9VKlbC/build/asan/bin/kudu as pid 8300
I20260620 14:47:45.884161 8059 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/wal/instance
I20260620 14:47:45.884209 8366 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:45.886780 8059 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9VKlbC/build/asan/bin/kudu
/tmp/dist-test-task9VKlbC/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.222.253:34209
--webserver_interface=127.7.222.253
--webserver_port=0
--builtin_ntp_servers=127.7.222.212:42755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--hive_metastore_uris=thrift://127.0.0.1:42797
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260620 14:47:45.890327 8366 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } has no permanent_uuid. Determining permanent_uuid...
I20260620 14:47:45.907073 8366 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } has no permanent_uuid. Determining permanent_uuid...
W20260620 14:47:45.908272 8317 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
W20260620 14:47:45.909891 8366 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.222.253:34209: Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
I20260620 14:47:45.959278 8366 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } attempt: 1
W20260620 14:47:45.961547 8366 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.222.253:34209: Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
I20260620 14:47:46.029872 8366 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } attempt: 2
W20260620 14:47:46.032100 8366 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.222.253:34209: Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
I20260620 14:47:46.123411 8366 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } attempt: 3
W20260620 14:47:46.125699 8366 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.222.253:34209: Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
W20260620 14:47:46.224419 8367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:47:46.224714 8367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:47:46.225005 8367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:47:46.232532 8367 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:47:46.232645 8367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:47:46.232689 8367 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:47:46.232807 8367 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:47:46.242762 8367 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.222.212:42755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:42797
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.222.253:34209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.222.253
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 13:41:20 UTC on ccycloud.quasar-vdagoi.root.comops.site
build id 4457462
ASAN enabled
I20260620 14:47:46.244182 8367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:47:46.246080 8367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:47:46.258823 8375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:47:46.259071 8376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:47:46.259320 8378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:47:46.260331 8367 server_base.cc:1034] running on GCE node
I20260620 14:47:46.261253 8367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:47:46.263016 8367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:47:46.264298 8367 hybrid_clock.cc:648] HybridClock initialized: now 1781966866264223 us; error 51 us; skew 500 ppm
I20260620 14:47:46.264650 8367 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 14:47:46.266942 8367 webserver.cc:460] Webserver started at http://127.7.222.253:40901/ using document root <none> and password file <none>
I20260620 14:47:46.267635 8367 fs_manager.cc:359] Metadata directory not provided
I20260620 14:47:46.267786 8367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:47:46.268087 8367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:47:46.268944 8366 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } attempt: 4
W20260620 14:47:46.271037 8366 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.222.253:34209: Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
I20260620 14:47:46.272516 8367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data/instance:
uuid: "caa9dcf251944f7d97f4ed7f3d83af44"
format_stamp: "Formatted at 2026-06-20 14:47:46 on dist-test-slave-c599"
I20260620 14:47:46.273466 8367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal/instance:
uuid: "caa9dcf251944f7d97f4ed7f3d83af44"
format_stamp: "Formatted at 2026-06-20 14:47:46 on dist-test-slave-c599"
I20260620 14:47:46.279506 8367 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260620 14:47:46.283675 8384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:47:46.285321 8367 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260620 14:47:46.285526 8367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data,/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
uuid: "caa9dcf251944f7d97f4ed7f3d83af44"
format_stamp: "Formatted at 2026-06-20 14:47:46 on dist-test-slave-c599"
I20260620 14:47:46.285748 8367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:47:46.320564 8367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:47:46.321627 8367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:47:46.321965 8367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:47:46.341409 8367 rpc_server.cc:307] RPC server started. Bound to: 127.7.222.253:34209
I20260620 14:47:46.341435 8435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.222.253:34209 every 8 connection(s)
I20260620 14:47:46.342804 8367 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data/info.pb
I20260620 14:47:46.345000 8059 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9VKlbC/build/asan/bin/kudu as pid 8367
I20260620 14:47:46.345168 8059 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal/instance
I20260620 14:47:46.346205 8059 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9VKlbC/build/asan/bin/kudu
/tmp/dist-test-task9VKlbC/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.222.252:36651
--webserver_interface=127.7.222.252
--webserver_port=0
--builtin_ntp_servers=127.7.222.212:42755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--hive_metastore_uris=thrift://127.0.0.1:42797
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260620 14:47:46.347373 8436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:46.356726 8436 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } has no permanent_uuid. Determining permanent_uuid...
I20260620 14:47:46.373103 8436 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } has no permanent_uuid. Determining permanent_uuid...
I20260620 14:47:46.383683 8436 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } has no permanent_uuid. Determining permanent_uuid...
W20260620 14:47:46.385502 8388 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
W20260620 14:47:46.387164 8436 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.222.252:36651: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:47:46.436506 8436 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } attempt: 1
W20260620 14:47:46.438709 8436 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.222.252:36651: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:47:46.506985 8436 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } attempt: 2
W20260620 14:47:46.509708 8436 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.222.252:36651: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:47:46.570334 8366 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } attempt: 5
I20260620 14:47:46.578825 8366 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } has no permanent_uuid. Determining permanent_uuid...
W20260620 14:47:46.581101 8366 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.222.252:36651: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:47:46.600945 8436 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } attempt: 3
W20260620 14:47:46.603070 8436 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.222.252:36651: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:47:46.632432 8366 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } attempt: 1
W20260620 14:47:46.634656 8366 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.222.252:36651: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
W20260620 14:47:46.690582 8437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:47:46.690969 8437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:47:46.691076 8437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:47:46.698566 8437 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:47:46.698657 8437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:47:46.698697 8437 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:47:46.698748 8437 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:47:46.702913 8366 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } attempt: 2
W20260620 14:47:46.705145 8366 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.222.252:36651: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:47:46.708463 8437 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.222.212:42755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:42797
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.222.252:36651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.222.252
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 13:41:20 UTC on ccycloud.quasar-vdagoi.root.comops.site
build id 4457462
ASAN enabled
I20260620 14:47:46.709823 8437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:47:46.711632 8437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:47:46.724265 8445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:47:46.724257 8446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:47:46.724284 8448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:47:46.725526 8437 server_base.cc:1034] running on GCE node
I20260620 14:47:46.726387 8437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:47:46.727875 8437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:47:46.729138 8437 hybrid_clock.cc:648] HybridClock initialized: now 1781966866729090 us; error 59 us; skew 500 ppm
I20260620 14:47:46.729508 8437 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 14:47:46.732220 8437 webserver.cc:460] Webserver started at http://127.7.222.252:40883/ using document root <none> and password file <none>
I20260620 14:47:46.732991 8437 fs_manager.cc:359] Metadata directory not provided
I20260620 14:47:46.733131 8437 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:47:46.733444 8437 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:47:46.736034 8437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/data/instance:
uuid: "61512e6d316d4d3a998e52511a0bba7a"
format_stamp: "Formatted at 2026-06-20 14:47:46 on dist-test-slave-c599"
I20260620 14:47:46.736855 8437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/wal/instance:
uuid: "61512e6d316d4d3a998e52511a0bba7a"
format_stamp: "Formatted at 2026-06-20 14:47:46 on dist-test-slave-c599"
I20260620 14:47:46.741930 8437 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260620 14:47:46.746260 8436 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } attempt: 4
I20260620 14:47:46.746196 8454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
W20260620 14:47:46.748152 8436 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.222.252:36651: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:47:46.748310 8437 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260620 14:47:46.748518 8437 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/data,/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/wal
uuid: "61512e6d316d4d3a998e52511a0bba7a"
format_stamp: "Formatted at 2026-06-20 14:47:46 on dist-test-slave-c599"
I20260620 14:47:46.748714 8437 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:47:46.786299 8437 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:47:46.787211 8437 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:47:46.787530 8437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:47:46.811372 8366 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } attempt: 3
I20260620 14:47:46.811596 8437 rpc_server.cc:307] RPC server started. Bound to: 127.7.222.252:36651
I20260620 14:47:46.811652 8505 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.222.252:36651 every 8 connection(s)
I20260620 14:47:46.813359 8437 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/data/info.pb
I20260620 14:47:46.815629 8059 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9VKlbC/build/asan/bin/kudu as pid 8437
I20260620 14:47:46.815825 8059 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/wal/instance
I20260620 14:47:46.818135 8507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:46.828300 8507 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } has no permanent_uuid. Determining permanent_uuid...
I20260620 14:47:46.840637 8366 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52: Bootstrap starting.
I20260620 14:47:46.842456 8507 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } has no permanent_uuid. Determining permanent_uuid...
I20260620 14:47:46.846027 8366 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:46.847693 8366 log.cc:824] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52: Log is configured to *not* fsync() on all Append() calls
I20260620 14:47:46.852052 8366 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52: No bootstrap required, opened a new log
I20260620 14:47:46.856058 8507 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } has no permanent_uuid. Determining permanent_uuid...
I20260620 14:47:46.862052 8366 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:46.862380 8366 raft_consensus.cc:374] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:46.862496 8366 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd308569015348a7a19ba4a560de6d52, State: Initialized, Role: FOLLOWER
I20260620 14:47:46.863233 8366 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:46.864132 8514 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:46.864516 8514 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:47:46.865490 8366 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:47:46.867055 8507 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: Bootstrap starting.
I20260620 14:47:46.871227 8507 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:46.872442 8507 log.cc:824] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: Log is configured to *not* fsync() on all Append() calls
I20260620 14:47:46.879253 8507 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: No bootstrap required, opened a new log
I20260620 14:47:46.889750 8507 raft_consensus.cc:348] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:46.890266 8507 raft_consensus.cc:374] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:46.890413 8507 raft_consensus.cc:729] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61512e6d316d4d3a998e52511a0bba7a, State: Initialized, Role: FOLLOWER
I20260620 14:47:46.891124 8507 consensus_queue.cc:260] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:46.882676 8300 master_runner.cc:186] Error getting master registration for 127.7.222.253:34209: OK, instance_id { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" instance_seqno: 1781966866336282 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260620 14:47:46.893865 8300 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 14:47:46.897585 8529 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 14:47:46.897742 8529 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 14:47:46.897746 8532 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:46.898175 8532 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:47:46.899060 8507 sys_catalog.cc:564] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: configured and running, proceeding with master startup.
W20260620 14:47:46.927680 8547 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260620 14:47:46.927947 8547 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260620 14:47:46.917408 8437 master_runner.cc:186] Error getting master registration for 127.7.222.253:34209: OK, instance_id { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" instance_seqno: 1781966866336282 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260620 14:47:46.930159 8437 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 14:47:47.039845 8460 tablet.cc:2369] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:47:47.047353 8436 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } attempt: 5
I20260620 14:47:47.064973 8436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Bootstrap starting.
I20260620 14:47:47.069309 8436 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:47.070711 8436 log.cc:824] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Log is configured to *not* fsync() on all Append() calls
I20260620 14:47:47.083779 8436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: No bootstrap required, opened a new log
I20260620 14:47:47.095476 8436 raft_consensus.cc:348] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:47.096024 8436 raft_consensus.cc:374] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:47.096184 8436 raft_consensus.cc:729] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa9dcf251944f7d97f4ed7f3d83af44, State: Initialized, Role: FOLLOWER
I20260620 14:47:47.097028 8436 consensus_queue.cc:260] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:47.099166 8514 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:47.099473 8514 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:47.102669 8481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dd308569015348a7a19ba4a560de6d52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61512e6d316d4d3a998e52511a0bba7a" is_pre_election: true
I20260620 14:47:47.103061 8514 leader_election.cc:288] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
I20260620 14:47:47.103317 8481 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd308569015348a7a19ba4a560de6d52 in term 0.
I20260620 14:47:47.104686 8318 leader_election.cc:302] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52; no voters:
I20260620 14:47:47.106171 8514 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:47.106318 8514 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:47.106412 8514 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:47.109014 8550 sys_catalog.cc:455] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:47.109428 8550 sys_catalog.cc:458] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:47:47.110211 8514 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
W20260620 14:47:47.111105 8320 tablet.cc:2369] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:47:47.111403 8436 sys_catalog.cc:564] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:47:47.111971 8410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dd308569015348a7a19ba4a560de6d52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa9dcf251944f7d97f4ed7f3d83af44"
I20260620 14:47:47.112457 8410 raft_consensus.cc:3037] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:47.115752 8410 raft_consensus.cc:2454] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd308569015348a7a19ba4a560de6d52 in term 1.
I20260620 14:47:47.116704 8317 leader_election.cc:302] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44, dd308569015348a7a19ba4a560de6d52; no voters:
I20260620 14:47:47.117309 8411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dd308569015348a7a19ba4a560de6d52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" is_pre_election: true
I20260620 14:47:47.117614 8411 raft_consensus.cc:2362] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate dd308569015348a7a19ba4a560de6d52 in term 1. Re-sending same reply.
I20260620 14:47:47.120332 8481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dd308569015348a7a19ba4a560de6d52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61512e6d316d4d3a998e52511a0bba7a"
I20260620 14:47:47.120543 8481 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:47.121170 8552 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:47.123723 8481 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd308569015348a7a19ba4a560de6d52 in term 1.
I20260620 14:47:47.124816 8514 leader_election.cc:288] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 1 election: Requested vote from peers caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
I20260620 14:47:47.132043 8552 raft_consensus.cc:686] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 1 LEADER]: Becoming Leader. State: Replica: dd308569015348a7a19ba4a560de6d52, State: Running, Role: LEADER
I20260620 14:47:47.132650 8552 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:47.146121 8514 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd308569015348a7a19ba4a560de6d52. Latest consensus state: current_term: 1 leader_uuid: "dd308569015348a7a19ba4a560de6d52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:47.146590 8514 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: This master's current role is: LEADER
I20260620 14:47:47.154129 8558 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:47:47.157007 8558 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:47:47.175247 8481 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 1 FOLLOWER]: Refusing update from remote peer dd308569015348a7a19ba4a560de6d52: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:47:47.176460 8514 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:47.184566 8410 raft_consensus.cc:1261] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 1 FOLLOWER]: Refusing update from remote peer dd308569015348a7a19ba4a560de6d52: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:47:47.185783 8514 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:47.220019 8550 sys_catalog.cc:455] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd308569015348a7a19ba4a560de6d52. Latest consensus state: current_term: 1 leader_uuid: "dd308569015348a7a19ba4a560de6d52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:47.220458 8550 sys_catalog.cc:458] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:47:47.224382 8560 mvcc.cc:205] Tried to move back new op lower bound from 7298936287936045056 to 7298936287780663296. Current Snapshot: MvccSnapshot[applied={T|T < 7298936287936045056}]
I20260620 14:47:47.230908 8564 mvcc.cc:205] Tried to move back new op lower bound from 7298936287936045056 to 7298936287780663296. Current Snapshot: MvccSnapshot[applied={T|T < 7298936287936045056}]
I20260620 14:47:47.236953 8532 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd308569015348a7a19ba4a560de6d52. Latest consensus state: current_term: 1 leader_uuid: "dd308569015348a7a19ba4a560de6d52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:47.237283 8532 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:47:47.239497 8514 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dd308569015348a7a19ba4a560de6d52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:47.239789 8514 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: This master's current role is: LEADER
I20260620 14:47:47.240052 8514 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dd308569015348a7a19ba4a560de6d52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:47.240293 8514 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: This master's current role is: LEADER
I20260620 14:47:47.240788 8550 sys_catalog.cc:455] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dd308569015348a7a19ba4a560de6d52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:47.241024 8550 sys_catalog.cc:458] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:47:47.249948 8558 catalog_manager.cc:1347] Generated new cluster ID: 700994c053c643c896af12c77a108604
I20260620 14:47:47.250087 8558 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:47:47.269121 8532 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dd308569015348a7a19ba4a560de6d52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:47.269454 8532 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:47:47.302528 8558 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 14:47:47.304301 8558 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:47:47.328835 8577 catalog_manager.cc:1259] Loaded cluster ID: 700994c053c643c896af12c77a108604
I20260620 14:47:47.329038 8577 catalog_manager.cc:1552] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: loading cluster ID for follower catalog manager: success
I20260620 14:47:47.350869 8558 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52: Generated new TSK 0
I20260620 14:47:47.352468 8558 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 14:47:47.359267 8558 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260620 14:47:47.361056 8558 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: -1
I20260620 14:47:47.364225 8577 catalog_manager.cc:1574] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: acquiring CA information for follower catalog manager: success
I20260620 14:47:47.367087 8577 catalog_manager.cc:1602] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 14:47:47.383054 8059 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9VKlbC/build/asan/bin/kudu
/tmp/dist-test-task9VKlbC/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.222.193:0
--local_ip_for_outbound_sockets=127.7.222.193
--webserver_interface=127.7.222.193
--webserver_port=0
--tserver_master_addrs=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--builtin_ntp_servers=127.7.222.212:42755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260620 14:47:47.801819 8579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:47:47.802137 8579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:47:47.802302 8579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:47:47.810501 8579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:47:47.810755 8579 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.222.193
I20260620 14:47:47.820236 8579 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.222.212:42755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.222.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.222.193
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.222.193
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 13:41:20 UTC on ccycloud.quasar-vdagoi.root.comops.site
build id 4457462
ASAN enabled
I20260620 14:47:47.821696 8579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:47:47.823575 8579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:47:47.837858 8584 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:47:47.837888 8585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:47:47.837924 8587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:47:47.839004 8579 server_base.cc:1034] running on GCE node
I20260620 14:47:47.839704 8579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:47:47.840704 8579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:47:47.841991 8579 hybrid_clock.cc:648] HybridClock initialized: now 1781966867841891 us; error 57 us; skew 500 ppm
I20260620 14:47:47.842309 8579 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 14:47:47.850062 8579 webserver.cc:460] Webserver started at http://127.7.222.193:38717/ using document root <none> and password file <none>
I20260620 14:47:47.850845 8579 fs_manager.cc:359] Metadata directory not provided
I20260620 14:47:47.851009 8579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:47:47.851325 8579 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:47:47.854188 8579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/data/instance:
uuid: "c0e6c57ab91e42bf9be3739c816916c0"
format_stamp: "Formatted at 2026-06-20 14:47:47 on dist-test-slave-c599"
I20260620 14:47:47.855050 8579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/wal/instance:
uuid: "c0e6c57ab91e42bf9be3739c816916c0"
format_stamp: "Formatted at 2026-06-20 14:47:47 on dist-test-slave-c599"
I20260620 14:47:47.858039 8592 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd308569015348a7a19ba4a560de6d52)
I20260620 14:47:47.858214 8592 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:47.859833 8592 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
I20260620 14:47:47.860318 8481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61512e6d316d4d3a998e52511a0bba7a" is_pre_election: true
I20260620 14:47:47.860455 8341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd308569015348a7a19ba4a560de6d52" is_pre_election: true
I20260620 14:47:47.861016 8579 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260620 14:47:47.861236 8385 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:47:47.861600 8592 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:47:47.864701 8594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:47:47.866336 8579 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260620 14:47:47.866516 8579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/data,/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/wal
uuid: "c0e6c57ab91e42bf9be3739c816916c0"
format_stamp: "Formatted at 2026-06-20 14:47:47 on dist-test-slave-c599"
I20260620 14:47:47.866696 8579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:47:47.882598 8579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:47:47.883441 8579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:47:47.883776 8579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:47:47.884904 8579 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:47:47.886615 8579 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:47:47.886708 8579 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:47:47.886842 8579 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:47:47.886919 8579 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:47:47.930948 8547 catalog_manager.cc:1259] Loaded cluster ID: 700994c053c643c896af12c77a108604
I20260620 14:47:47.931072 8547 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: loading cluster ID for follower catalog manager: success
I20260620 14:47:47.935541 8547 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: acquiring CA information for follower catalog manager: success
I20260620 14:47:47.938629 8547 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 14:47:47.951169 8579 rpc_server.cc:307] RPC server started. Bound to: 127.7.222.193:33821
I20260620 14:47:47.951203 8706 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.222.193:33821 every 8 connection(s)
I20260620 14:47:47.952567 8579 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/data/info.pb
I20260620 14:47:47.956326 8059 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9VKlbC/build/asan/bin/kudu as pid 8579
I20260620 14:47:47.956554 8059 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/wal/instance
I20260620 14:47:47.965281 8059 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9VKlbC/build/asan/bin/kudu
/tmp/dist-test-task9VKlbC/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.222.194:0
--local_ip_for_outbound_sockets=127.7.222.194
--webserver_interface=127.7.222.194
--webserver_port=0
--tserver_master_addrs=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--builtin_ntp_servers=127.7.222.212:42755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260620 14:47:47.980401 8708 heartbeater.cc:347] Connected to a master server at 127.7.222.254:39515
I20260620 14:47:47.980510 8707 heartbeater.cc:347] Connected to a master server at 127.7.222.252:36651
I20260620 14:47:47.980801 8707 heartbeater.cc:464] Registering TS with master...
I20260620 14:47:47.980868 8709 heartbeater.cc:347] Connected to a master server at 127.7.222.253:34209
I20260620 14:47:47.980924 8708 heartbeater.cc:464] Registering TS with master...
I20260620 14:47:47.981304 8709 heartbeater.cc:464] Registering TS with master...
I20260620 14:47:47.981957 8709 heartbeater.cc:511] Master 127.7.222.253:34209 requested a full tablet report, sending...
I20260620 14:47:47.981993 8708 heartbeater.cc:511] Master 127.7.222.254:39515 requested a full tablet report, sending...
I20260620 14:47:47.982018 8707 heartbeater.cc:511] Master 127.7.222.252:36651 requested a full tablet report, sending...
I20260620 14:47:47.984261 8401 ts_manager.cc:194] Registered new tserver with Master: c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:47:47.984400 8330 ts_manager.cc:194] Registered new tserver with Master: c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:47:47.985795 8471 ts_manager.cc:194] Registered new tserver with Master: c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:47:47.986694 8330 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.222.193:40695
W20260620 14:47:48.314790 8717 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:47:48.315076 8717 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:47:48.315172 8717 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:47:48.323251 8717 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:47:48.323439 8717 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.222.194
I20260620 14:47:48.333065 8717 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.222.212:42755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.222.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.222.194
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.222.194
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 13:41:20 UTC on ccycloud.quasar-vdagoi.root.comops.site
build id 4457462
ASAN enabled
I20260620 14:47:48.334362 8717 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:47:48.336104 8717 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:47:48.349908 8722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:47:48.350334 8725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:47:48.349973 8723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:47:48.352203 8717 server_base.cc:1034] running on GCE node
I20260620 14:47:48.353029 8717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:47:48.354095 8717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:47:48.355386 8717 hybrid_clock.cc:648] HybridClock initialized: now 1781966868355318 us; error 43 us; skew 500 ppm
I20260620 14:47:48.355705 8717 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 14:47:48.359268 8717 webserver.cc:460] Webserver started at http://127.7.222.194:44043/ using document root <none> and password file <none>
I20260620 14:47:48.360034 8717 fs_manager.cc:359] Metadata directory not provided
I20260620 14:47:48.360193 8717 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:47:48.360522 8717 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:47:48.363732 8717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/data/instance:
uuid: "36236dd5bd604ba2819038e525a3790c"
format_stamp: "Formatted at 2026-06-20 14:47:48 on dist-test-slave-c599"
I20260620 14:47:48.364607 8717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal/instance:
uuid: "36236dd5bd604ba2819038e525a3790c"
format_stamp: "Formatted at 2026-06-20 14:47:48 on dist-test-slave-c599"
I20260620 14:47:48.370690 8717 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260620 14:47:48.374361 8731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:47:48.375814 8717 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260620 14:47:48.376012 8717 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/data,/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal
uuid: "36236dd5bd604ba2819038e525a3790c"
format_stamp: "Formatted at 2026-06-20 14:47:48 on dist-test-slave-c599"
I20260620 14:47:48.376224 8717 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:47:48.398339 8717 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:47:48.399331 8717 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:47:48.400064 8717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:47:48.401064 8717 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:47:48.402500 8717 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:47:48.402601 8717 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:47:48.402751 8717 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:47:48.402835 8717 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:47:48.404323 8739 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd308569015348a7a19ba4a560de6d52)
I20260620 14:47:48.404500 8739 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:48.405156 8739 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
I20260620 14:47:48.405687 8481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61512e6d316d4d3a998e52511a0bba7a" is_pre_election: true
I20260620 14:47:48.405683 8341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd308569015348a7a19ba4a560de6d52" is_pre_election: true
I20260620 14:47:48.406383 8388 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:47:48.406651 8739 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:47:48.440248 8717 rpc_server.cc:307] RPC server started. Bound to: 127.7.222.194:39159
I20260620 14:47:48.440292 8844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.222.194:39159 every 8 connection(s)
I20260620 14:47:48.441569 8717 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/data/info.pb
I20260620 14:47:48.447309 8059 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9VKlbC/build/asan/bin/kudu as pid 8717
I20260620 14:47:48.447537 8059 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal/instance
I20260620 14:47:48.457329 8059 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9VKlbC/build/asan/bin/kudu
/tmp/dist-test-task9VKlbC/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.222.195:0
--local_ip_for_outbound_sockets=127.7.222.195
--webserver_interface=127.7.222.195
--webserver_port=0
--tserver_master_addrs=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--builtin_ntp_servers=127.7.222.212:42755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260620 14:47:48.489949 8708 heartbeater.cc:503] Master 127.7.222.254:39515 was elected leader, sending a full tablet report...
I20260620 14:47:48.491209 8846 heartbeater.cc:347] Connected to a master server at 127.7.222.254:39515
I20260620 14:47:48.491546 8846 heartbeater.cc:464] Registering TS with master...
I20260620 14:47:48.492842 8846 heartbeater.cc:511] Master 127.7.222.254:39515 requested a full tablet report, sending...
I20260620 14:47:48.495280 8330 ts_manager.cc:194] Registered new tserver with Master: 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:48.496384 8330 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.222.194:50465
I20260620 14:47:48.500447 8845 heartbeater.cc:347] Connected to a master server at 127.7.222.252:36651
I20260620 14:47:48.500608 8845 heartbeater.cc:464] Registering TS with master...
I20260620 14:47:48.501072 8845 heartbeater.cc:511] Master 127.7.222.252:36651 requested a full tablet report, sending...
I20260620 14:47:48.501375 8847 heartbeater.cc:347] Connected to a master server at 127.7.222.253:34209
I20260620 14:47:48.501523 8847 heartbeater.cc:464] Registering TS with master...
I20260620 14:47:48.501837 8847 heartbeater.cc:511] Master 127.7.222.253:34209 requested a full tablet report, sending...
I20260620 14:47:48.502156 8471 ts_manager.cc:194] Registered new tserver with Master: 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:48.502823 8401 ts_manager.cc:194] Registered new tserver with Master: 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:48.769682 8853 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd308569015348a7a19ba4a560de6d52)
I20260620 14:47:48.769856 8853 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:48.771277 8853 leader_election.cc:288] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209)
I20260620 14:47:48.771906 8341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "61512e6d316d4d3a998e52511a0bba7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd308569015348a7a19ba4a560de6d52" is_pre_election: true
I20260620 14:47:48.771940 8411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "61512e6d316d4d3a998e52511a0bba7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" is_pre_election: true
I20260620 14:47:48.772734 8457 leader_election.cc:302] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61512e6d316d4d3a998e52511a0bba7a; no voters: caa9dcf251944f7d97f4ed7f3d83af44, dd308569015348a7a19ba4a560de6d52
I20260620 14:47:48.773172 8853 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:47:48.833002 8852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:47:48.833273 8852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:47:48.833463 8852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:47:48.841289 8852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:47:48.841506 8852 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.222.195
I20260620 14:47:48.850415 8852 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.222.212:42755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.222.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.222.195
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.222.195
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 13:41:20 UTC on ccycloud.quasar-vdagoi.root.comops.site
build id 4457462
ASAN enabled
I20260620 14:47:48.851874 8852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:47:48.853724 8852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:47:48.868336 8858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:47:48.868348 8859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:47:48.868539 8861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:47:48.869303 8852 server_base.cc:1034] running on GCE node
I20260620 14:47:48.870012 8852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:47:48.871060 8852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:47:48.872272 8852 hybrid_clock.cc:648] HybridClock initialized: now 1781966868872194 us; error 53 us; skew 500 ppm
I20260620 14:47:48.872575 8852 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 14:47:48.875571 8852 webserver.cc:460] Webserver started at http://127.7.222.195:37269/ using document root <none> and password file <none>
I20260620 14:47:48.876271 8852 fs_manager.cc:359] Metadata directory not provided
I20260620 14:47:48.876405 8852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:47:48.876715 8852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 14:47:48.879647 8852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/data/instance:
uuid: "6c99207e35f8463292d71c371c9546b4"
format_stamp: "Formatted at 2026-06-20 14:47:48 on dist-test-slave-c599"
I20260620 14:47:48.880558 8852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal/instance:
uuid: "6c99207e35f8463292d71c371c9546b4"
format_stamp: "Formatted at 2026-06-20 14:47:48 on dist-test-slave-c599"
I20260620 14:47:48.886076 8852 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260620 14:47:48.889451 8867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:47:48.890911 8852 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260620 14:47:48.891073 8852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/data,/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal
uuid: "6c99207e35f8463292d71c371c9546b4"
format_stamp: "Formatted at 2026-06-20 14:47:48 on dist-test-slave-c599"
I20260620 14:47:48.891258 8852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:47:48.928253 8852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:47:48.929183 8852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:47:48.929495 8852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:47:48.930516 8852 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 14:47:48.932200 8852 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 14:47:48.932314 8852 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260620 14:47:48.932423 8852 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 14:47:48.932492 8852 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260620 14:47:48.969780 8852 rpc_server.cc:307] RPC server started. Bound to: 127.7.222.195:45279
I20260620 14:47:48.969949 8979 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.222.195:45279 every 8 connection(s)
I20260620 14:47:48.971272 8852 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/data/info.pb
I20260620 14:47:48.971987 8059 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9VKlbC/build/asan/bin/kudu as pid 8852
I20260620 14:47:48.972563 8059 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal/instance
I20260620 14:47:49.000481 8846 heartbeater.cc:503] Master 127.7.222.254:39515 was elected leader, sending a full tablet report...
I20260620 14:47:49.004798 8980 heartbeater.cc:347] Connected to a master server at 127.7.222.252:36651
I20260620 14:47:49.005079 8982 heartbeater.cc:347] Connected to a master server at 127.7.222.253:34209
I20260620 14:47:49.005157 8980 heartbeater.cc:464] Registering TS with master...
I20260620 14:47:49.005231 8982 heartbeater.cc:464] Registering TS with master...
I20260620 14:47:49.006029 8981 heartbeater.cc:347] Connected to a master server at 127.7.222.254:39515
I20260620 14:47:49.006191 8981 heartbeater.cc:464] Registering TS with master...
I20260620 14:47:49.006230 8982 heartbeater.cc:511] Master 127.7.222.253:34209 requested a full tablet report, sending...
I20260620 14:47:49.006258 8980 heartbeater.cc:511] Master 127.7.222.252:36651 requested a full tablet report, sending...
I20260620 14:47:49.006593 8981 heartbeater.cc:511] Master 127.7.222.254:39515 requested a full tablet report, sending...
I20260620 14:47:49.007822 8330 ts_manager.cc:194] Registered new tserver with Master: 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:47:49.007894 8401 ts_manager.cc:194] Registered new tserver with Master: 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:47:49.007871 8471 ts_manager.cc:194] Registered new tserver with Master: 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:47:49.008806 8330 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.222.195:38933
I20260620 14:47:49.018081 8059 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260620 14:47:49.036218 8994 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd308569015348a7a19ba4a560de6d52)
I20260620 14:47:49.036430 8994 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:49.037192 8994 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
I20260620 14:47:49.037662 8481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "61512e6d316d4d3a998e52511a0bba7a" is_pre_election: true
I20260620 14:47:49.037747 8341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd308569015348a7a19ba4a560de6d52" is_pre_election: true
I20260620 14:47:49.038321 8385 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:47:49.038625 8994 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:47:49.055229 8330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59860:
name: "default.Table_c4d3487a7a79427b9d03ce0524ea33a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:49.055250 8331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59860:
name: "default.Table_8e881e3d74304c008c2588c42a082659"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:49.056020 8329 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59860:
name: "default.Table_0eb776233cee4294b6c96ec556447663"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:49.056593 8328 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59860:
name: "default.Table_0210e4215f5f4663af08e8f4da05f3b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:49.059263 8324 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59860:
name: "default.Table_b702c9d170e842fa824a76fb4be199fb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:49.059478 8322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59860:
name: "default.Table_116796b0dc6c4dbd97c4f0c519f6d18f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:49.060092 8327 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59860:
name: "default.Table_1d0410429a7242ab85d16d800ffd0502"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:49.060669 8326 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59860:
name: "default.Table_7f82e63c368b415ca9ea3cd201986de1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:49.061224 8323 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59860:
name: "default.Table_de1c78a84d1349dea4d9e9d032a258be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:49.061787 8325 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59860:
name: "default.Table_a800f01d336648a8b400cefc457c444d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260620 14:47:49.064771 8331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_8e881e3d74304c008c2588c42a082659 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:47:49.070003 8059 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task9VKlbC/build/asan/bin/kudu pid 8367
I20260620 14:47:49.072028 8431 generic_service.cc:196] Checking for leaks (request via RPC)
I20260620 14:47:49.246735 8059 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9VKlbC/build/asan/bin/kudu with pid 8367
I20260620 14:47:49.366568 9028 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd308569015348a7a19ba4a560de6d52)
I20260620 14:47:49.366827 9028 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:49.367667 9028 leader_election.cc:288] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209)
I20260620 14:47:49.368438 8341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "61512e6d316d4d3a998e52511a0bba7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd308569015348a7a19ba4a560de6d52" is_pre_election: true
W20260620 14:47:49.369433 8457 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
W20260620 14:47:49.371078 8457 leader_election.cc:334] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209): Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
I20260620 14:47:49.371232 8457 leader_election.cc:302] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61512e6d316d4d3a998e52511a0bba7a; no voters: caa9dcf251944f7d97f4ed7f3d83af44, dd308569015348a7a19ba4a560de6d52
I20260620 14:47:49.371623 9028 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:47:49.485553 8331 catalog_manager.cc:2148] created HMS catalog entry for table [id=98d2e7b647544a97b50827a0cb2799a0]
W20260620 14:47:49.488094 8324 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_b702c9d170e842fa824a76fb4be199fb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 14:47:49.488188 8328 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_0210e4215f5f4663af08e8f4da05f3b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 14:47:49.488441 8330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_c4d3487a7a79427b9d03ce0524ea33a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 14:47:49.489702 8322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_116796b0dc6c4dbd97c4f0c519f6d18f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 14:47:49.490515 8325 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_a800f01d336648a8b400cefc457c444d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 14:47:49.491083 8327 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_1d0410429a7242ab85d16d800ffd0502 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 14:47:49.492204 8326 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_7f82e63c368b415ca9ea3cd201986de1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 14:47:49.493106 8323 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_de1c78a84d1349dea4d9e9d032a258be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 14:47:49.488101 8329 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_0eb776233cee4294b6c96ec556447663 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 14:47:49.506953 8317 consensus_peers.cc:487] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 -> Peer caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209): Couldn't send request to peer caa9dcf251944f7d97f4ed7f3d83af44. Status: Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 14:47:49.510890 8981 heartbeater.cc:503] Master 127.7.222.254:39515 was elected leader, sending a full tablet report...
W20260620 14:47:49.520725 8847 heartbeater.cc:644] Failed to heartbeat to 127.7.222.253:34209 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
W20260620 14:47:49.526036 8982 heartbeater.cc:644] Failed to heartbeat to 127.7.222.253:34209 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
W20260620 14:47:49.537025 8709 heartbeater.cc:644] Failed to heartbeat to 127.7.222.253:34209 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
I20260620 14:47:49.542894 8324 catalog_manager.cc:2148] created HMS catalog entry for table [id=c65e926af55d4fbba6c42f4d2ddbb397]
I20260620 14:47:49.548513 8331 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59860:
table { table_name: "default.Table_8e881e3d74304c008c2588c42a082659" } new_table_name: "default.Table_19c624001d444b7b9939e22128c594aa" modify_external_catalogs: true
I20260620 14:47:49.552842 8324 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59860:
table { table_name: "default.Table_b702c9d170e842fa824a76fb4be199fb" } new_table_name: "default.Table_a901d915c377429a9e43cfcaf071e7d3" modify_external_catalogs: true
I20260620 14:47:49.583649 8780 tablet_service.cc:1467] Processing CreateTablet for tablet 4d3010d65aa944798b48df808633bc15 (DEFAULT_TABLE table=default.table_8e881e3d74304c008c2588c42a082659 [id=98d2e7b647544a97b50827a0cb2799a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:49.585480 8780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d3010d65aa944798b48df808633bc15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:49.587544 8779 tablet_service.cc:1467] Processing CreateTablet for tablet b687f0fcc5bf46b49ea3705872c6af70 (DEFAULT_TABLE table=default.table_b702c9d170e842fa824a76fb4be199fb [id=c65e926af55d4fbba6c42f4d2ddbb397]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:49.588197 8779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b687f0fcc5bf46b49ea3705872c6af70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:49.595978 8328 catalog_manager.cc:2148] created HMS catalog entry for table [id=9c1e21a6c9244efba2e86bfa28264a0d]
I20260620 14:47:49.611156 8915 tablet_service.cc:1467] Processing CreateTablet for tablet 4d3010d65aa944798b48df808633bc15 (DEFAULT_TABLE table=default.table_8e881e3d74304c008c2588c42a082659 [id=98d2e7b647544a97b50827a0cb2799a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:49.614948 8328 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59860:
table { table_name: "default.Table_0210e4215f5f4663af08e8f4da05f3b3" } new_table_name: "default.Table_e8372b71bacb4865b4360a50af59d323" modify_external_catalogs: true
I20260620 14:47:49.612103 8914 tablet_service.cc:1467] Processing CreateTablet for tablet b687f0fcc5bf46b49ea3705872c6af70 (DEFAULT_TABLE table=default.table_b702c9d170e842fa824a76fb4be199fb [id=c65e926af55d4fbba6c42f4d2ddbb397]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:49.615808 8642 tablet_service.cc:1467] Processing CreateTablet for tablet 4d3010d65aa944798b48df808633bc15 (DEFAULT_TABLE table=default.table_8e881e3d74304c008c2588c42a082659 [id=98d2e7b647544a97b50827a0cb2799a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:49.616807 8914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b687f0fcc5bf46b49ea3705872c6af70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:49.617208 8642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d3010d65aa944798b48df808633bc15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:49.617170 8641 tablet_service.cc:1467] Processing CreateTablet for tablet b687f0fcc5bf46b49ea3705872c6af70 (DEFAULT_TABLE table=default.table_b702c9d170e842fa824a76fb4be199fb [id=c65e926af55d4fbba6c42f4d2ddbb397]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:49.617599 8641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b687f0fcc5bf46b49ea3705872c6af70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:49.619719 8915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d3010d65aa944798b48df808633bc15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:49.621979 8913 tablet_service.cc:1467] Processing CreateTablet for tablet 514af46a4b0c4c2f8e27b65a1322e976 (DEFAULT_TABLE table=default.table_0210e4215f5f4663af08e8f4da05f3b3 [id=9c1e21a6c9244efba2e86bfa28264a0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:49.622505 8913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 514af46a4b0c4c2f8e27b65a1322e976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:49.623715 8778 tablet_service.cc:1467] Processing CreateTablet for tablet 514af46a4b0c4c2f8e27b65a1322e976 (DEFAULT_TABLE table=default.table_0210e4215f5f4663af08e8f4da05f3b3 [id=9c1e21a6c9244efba2e86bfa28264a0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:49.624436 8778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 514af46a4b0c4c2f8e27b65a1322e976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:49.629756 8640 tablet_service.cc:1467] Processing CreateTablet for tablet 514af46a4b0c4c2f8e27b65a1322e976 (DEFAULT_TABLE table=default.table_0210e4215f5f4663af08e8f4da05f3b3 [id=9c1e21a6c9244efba2e86bfa28264a0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:49.630483 8640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 514af46a4b0c4c2f8e27b65a1322e976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:49.645602 9048 tablet_bootstrap.cc:492] T b687f0fcc5bf46b49ea3705872c6af70 P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:49.649897 9048 tablet_bootstrap.cc:654] T b687f0fcc5bf46b49ea3705872c6af70 P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:49.651532 9048 log.cc:824] T b687f0fcc5bf46b49ea3705872c6af70 P 36236dd5bd604ba2819038e525a3790c: Log is configured to *not* fsync() on all Append() calls
I20260620 14:47:49.663987 9051 tablet_bootstrap.cc:492] T 4d3010d65aa944798b48df808633bc15 P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:49.665290 9048 tablet_bootstrap.cc:492] T b687f0fcc5bf46b49ea3705872c6af70 P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:49.665657 9048 ts_tablet_manager.cc:1397] T b687f0fcc5bf46b49ea3705872c6af70 P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.020s user 0.010s sys 0.002s
I20260620 14:47:49.666477 9049 tablet_bootstrap.cc:492] T 4d3010d65aa944798b48df808633bc15 P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:49.670230 9049 tablet_bootstrap.cc:654] T 4d3010d65aa944798b48df808633bc15 P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:49.671558 9051 tablet_bootstrap.cc:654] T 4d3010d65aa944798b48df808633bc15 P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:49.671710 9049 log.cc:824] T 4d3010d65aa944798b48df808633bc15 P c0e6c57ab91e42bf9be3739c816916c0: Log is configured to *not* fsync() on all Append() calls
I20260620 14:47:49.673223 9051 log.cc:824] T 4d3010d65aa944798b48df808633bc15 P 6c99207e35f8463292d71c371c9546b4: Log is configured to *not* fsync() on all Append() calls
I20260620 14:47:49.673596 8330 catalog_manager.cc:2148] created HMS catalog entry for table [id=c514aca79062490a8b6a18021b07b2ff]
I20260620 14:47:49.682730 8330 master_service.cc:946] ReplaceTablet: received request to replace tablet 4d3010d65aa944798b48df808633bc15 from {username='slave'} at 127.0.0.1:59860
I20260620 14:47:49.686216 9048 raft_consensus.cc:348] T b687f0fcc5bf46b49ea3705872c6af70 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:49.689509 9049 tablet_bootstrap.cc:492] T 4d3010d65aa944798b48df808633bc15 P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:49.689707 9048 raft_consensus.cc:374] T b687f0fcc5bf46b49ea3705872c6af70 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:49.689855 9048 raft_consensus.cc:729] T b687f0fcc5bf46b49ea3705872c6af70 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:49.690608 9048 consensus_queue.cc:260] T b687f0fcc5bf46b49ea3705872c6af70 P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:49.694732 8330 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52: Sending DeleteTablet for 3 replicas of tablet 4d3010d65aa944798b48df808633bc15
I20260620 14:47:49.697149 9049 ts_tablet_manager.cc:1397] T 4d3010d65aa944798b48df808633bc15 P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.031s user 0.014s sys 0.008s
I20260620 14:47:49.699735 8330 catalog_manager.cc:6565] ReplaceTablet: tablet 4d3010d65aa944798b48df808633bc15 deleted and replaced by tablet 1ad679f398ab41a1bc207b016648cbe8
I20260620 14:47:49.700126 8330 master_service.cc:946] ReplaceTablet: received request to replace tablet 4d3010d65aa944798b48df808633bc15 from {username='slave'} at 127.0.0.1:59860
I20260620 14:47:49.700886 8642 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d3010d65aa944798b48df808633bc15 with delete_type TABLET_DATA_DELETED (replaced by tablet 1ad679f398ab41a1bc207b016648cbe8) from {username='slave'} at 127.0.0.1:52276
I20260620 14:47:49.701648 8915 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d3010d65aa944798b48df808633bc15 with delete_type TABLET_DATA_DELETED (replaced by tablet 1ad679f398ab41a1bc207b016648cbe8) from {username='slave'} at 127.0.0.1:56438
I20260620 14:47:49.702692 9051 tablet_bootstrap.cc:492] T 4d3010d65aa944798b48df808633bc15 P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:49.703027 9051 ts_tablet_manager.cc:1397] T 4d3010d65aa944798b48df808633bc15 P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.039s user 0.000s sys 0.019s
I20260620 14:47:49.704684 8778 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d3010d65aa944798b48df808633bc15 with delete_type TABLET_DATA_DELETED (replaced by tablet 1ad679f398ab41a1bc207b016648cbe8) from {username='slave'} at 127.0.0.1:49700
I20260620 14:47:49.706365 9048 ts_tablet_manager.cc:1428] T b687f0fcc5bf46b49ea3705872c6af70 P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.041s user 0.011s sys 0.003s
I20260620 14:47:49.713025 9049 raft_consensus.cc:348] T 4d3010d65aa944798b48df808633bc15 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:49.713562 9049 raft_consensus.cc:374] T 4d3010d65aa944798b48df808633bc15 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:49.713685 9049 raft_consensus.cc:729] T 4d3010d65aa944798b48df808633bc15 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:49.714507 9049 consensus_queue.cc:260] T 4d3010d65aa944798b48df808633bc15 P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:49.715993 9048 tablet_bootstrap.cc:492] T 4d3010d65aa944798b48df808633bc15 P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:49.717905 9048 tablet_bootstrap.cc:654] T 4d3010d65aa944798b48df808633bc15 P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:49.727309 9048 tablet_bootstrap.cc:492] T 4d3010d65aa944798b48df808633bc15 P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:49.727535 9048 ts_tablet_manager.cc:1397] T 4d3010d65aa944798b48df808633bc15 P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.004s
I20260620 14:47:49.728591 9048 raft_consensus.cc:348] T 4d3010d65aa944798b48df808633bc15 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:49.728871 9048 raft_consensus.cc:374] T 4d3010d65aa944798b48df808633bc15 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:49.728993 9048 raft_consensus.cc:729] T 4d3010d65aa944798b48df808633bc15 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:49.729761 8913 tablet_service.cc:1467] Processing CreateTablet for tablet 79da710506b745fb8e807b52a9dc54ab (DEFAULT_TABLE table=default.table_c4d3487a7a79427b9d03ce0524ea33a8 [id=c514aca79062490a8b6a18021b07b2ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:49.730262 8913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79da710506b745fb8e807b52a9dc54ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:49.733217 8640 tablet_service.cc:1467] Processing CreateTablet for tablet 79da710506b745fb8e807b52a9dc54ab (DEFAULT_TABLE table=default.table_c4d3487a7a79427b9d03ce0524ea33a8 [id=c514aca79062490a8b6a18021b07b2ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:49.733700 8640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79da710506b745fb8e807b52a9dc54ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:49.737175 8779 tablet_service.cc:1467] Processing CreateTablet for tablet 79da710506b745fb8e807b52a9dc54ab (DEFAULT_TABLE table=default.table_c4d3487a7a79427b9d03ce0524ea33a8 [id=c514aca79062490a8b6a18021b07b2ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:49.737706 8779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79da710506b745fb8e807b52a9dc54ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:49.744344 8641 tablet_service.cc:1467] Processing CreateTablet for tablet 1ad679f398ab41a1bc207b016648cbe8 (DEFAULT_TABLE table=default.table_8e881e3d74304c008c2588c42a082659 [id=98d2e7b647544a97b50827a0cb2799a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:49.744879 8641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ad679f398ab41a1bc207b016648cbe8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 14:47:49.747300 8848 tablet.cc:2369] T b687f0fcc5bf46b49ea3705872c6af70 P 36236dd5bd604ba2819038e525a3790c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:47:49.751060 8330 master_service.cc:946] ReplaceTablet: received request to replace tablet b687f0fcc5bf46b49ea3705872c6af70 from {username='slave'} at 127.0.0.1:59860
I20260620 14:47:49.729281 9048 consensus_queue.cc:260] T 4d3010d65aa944798b48df808633bc15 P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:49.752436 9048 ts_tablet_manager.cc:1428] T 4d3010d65aa944798b48df808633bc15 P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.025s user 0.003s sys 0.000s
I20260620 14:47:49.758520 8322 catalog_manager.cc:2148] created HMS catalog entry for table [id=0c4867ea1c1e45f388ccd4e2c9de093e]
I20260620 14:47:49.762959 8779 tablet_service.cc:1467] Processing CreateTablet for tablet 1ad679f398ab41a1bc207b016648cbe8 (DEFAULT_TABLE table=default.table_8e881e3d74304c008c2588c42a082659 [id=98d2e7b647544a97b50827a0cb2799a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:49.763633 8779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ad679f398ab41a1bc207b016648cbe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:49.768227 8913 tablet_service.cc:1467] Processing CreateTablet for tablet 1ad679f398ab41a1bc207b016648cbe8 (DEFAULT_TABLE table=default.table_8e881e3d74304c008c2588c42a082659 [id=98d2e7b647544a97b50827a0cb2799a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:49.768703 8913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ad679f398ab41a1bc207b016648cbe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:49.776912 8330 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52: Sending DeleteTablet for 3 replicas of tablet b687f0fcc5bf46b49ea3705872c6af70
I20260620 14:47:49.777882 9048 tablet_bootstrap.cc:492] T 514af46a4b0c4c2f8e27b65a1322e976 P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:49.778869 8914 tablet_service.cc:1514] Processing DeleteTablet for tablet b687f0fcc5bf46b49ea3705872c6af70 with delete_type TABLET_DATA_DELETED (replaced by tablet bd541e6a431348c7a506611681730fc5) from {username='slave'} at 127.0.0.1:56438
I20260620 14:47:49.778891 8780 tablet_service.cc:1514] Processing DeleteTablet for tablet b687f0fcc5bf46b49ea3705872c6af70 with delete_type TABLET_DATA_DELETED (replaced by tablet bd541e6a431348c7a506611681730fc5) from {username='slave'} at 127.0.0.1:49700
I20260620 14:47:49.779093 8330 catalog_manager.cc:6565] ReplaceTablet: tablet b687f0fcc5bf46b49ea3705872c6af70 deleted and replaced by tablet bd541e6a431348c7a506611681730fc5
I20260620 14:47:49.779383 8330 master_service.cc:946] ReplaceTablet: received request to replace tablet 4d3010d65aa944798b48df808633bc15 from {username='slave'} at 127.0.0.1:59860
I20260620 14:47:49.782130 8640 tablet_service.cc:1514] Processing DeleteTablet for tablet b687f0fcc5bf46b49ea3705872c6af70 with delete_type TABLET_DATA_DELETED (replaced by tablet bd541e6a431348c7a506611681730fc5) from {username='slave'} at 127.0.0.1:52276
I20260620 14:47:49.783667 9048 tablet_bootstrap.cc:654] T 514af46a4b0c4c2f8e27b65a1322e976 P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:49.791054 9051 raft_consensus.cc:348] T 4d3010d65aa944798b48df808633bc15 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:49.791782 9051 raft_consensus.cc:374] T 4d3010d65aa944798b48df808633bc15 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:49.792102 9051 raft_consensus.cc:729] T 4d3010d65aa944798b48df808633bc15 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:49.793195 9051 consensus_queue.cc:260] T 4d3010d65aa944798b48df808633bc15 P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
W20260620 14:47:49.807552 8316 catalog_manager.cc:4821] TS 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): delete failed for tablet 4d3010d65aa944798b48df808633bc15 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d3010d65aa944798b48df808633bc15 already in progress: creating tablet
W20260620 14:47:49.808531 8316 catalog_manager.cc:4821] TS 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): delete failed for tablet b687f0fcc5bf46b49ea3705872c6af70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b687f0fcc5bf46b49ea3705872c6af70 already in progress: creating tablet
I20260620 14:47:49.809616 9057 tablet_replica.cc:330] T 4d3010d65aa944798b48df808633bc15 P 36236dd5bd604ba2819038e525a3790c: stopping tablet replica
I20260620 14:47:49.810451 9057 raft_consensus.cc:2229] T 4d3010d65aa944798b48df808633bc15 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:49.811013 9057 raft_consensus.cc:2258] T 4d3010d65aa944798b48df808633bc15 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:49.812964 8322 master_service.cc:946] ReplaceTablet: received request to replace tablet 514af46a4b0c4c2f8e27b65a1322e976 from {username='slave'} at 127.0.0.1:59860
I20260620 14:47:49.813651 9057 ts_tablet_manager.cc:1905] T 4d3010d65aa944798b48df808633bc15 P 36236dd5bd604ba2819038e525a3790c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:49.818949 8330 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59860:
table { table_name: "default.Table_c4d3487a7a79427b9d03ce0524ea33a8" } new_table_name: "default.Table_fe5ad6a8d59b4751bcbb6e1d0d4baedb" modify_external_catalogs: true
I20260620 14:47:49.820914 8322 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52: Sending DeleteTablet for 3 replicas of tablet 514af46a4b0c4c2f8e27b65a1322e976
I20260620 14:47:49.821419 8322 catalog_manager.cc:6565] ReplaceTablet: tablet 514af46a4b0c4c2f8e27b65a1322e976 deleted and replaced by tablet bdd71e7f271c40d4b722f38d32b1ea1d
I20260620 14:47:49.821802 8322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59860:
name: "default.Table_bb493f9370e74bafae7b1e42f5c5f770"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:49.832628 8914 tablet_service.cc:1467] Processing CreateTablet for tablet 675413dc550f485dbef0d180ed27ff0e (DEFAULT_TABLE table=default.table_116796b0dc6c4dbd97c4f0c519f6d18f [id=0c4867ea1c1e45f388ccd4e2c9de093e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:49.833431 8914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 675413dc550f485dbef0d180ed27ff0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:49.833629 8639 tablet_service.cc:1467] Processing CreateTablet for tablet bd541e6a431348c7a506611681730fc5 (DEFAULT_TABLE table=default.table_b702c9d170e842fa824a76fb4be199fb [id=c65e926af55d4fbba6c42f4d2ddbb397]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:49.834088 8639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd541e6a431348c7a506611681730fc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:49.840694 8779 tablet_service.cc:1467] Processing CreateTablet for tablet 675413dc550f485dbef0d180ed27ff0e (DEFAULT_TABLE table=default.table_116796b0dc6c4dbd97c4f0c519f6d18f [id=0c4867ea1c1e45f388ccd4e2c9de093e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:49.841296 8779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 675413dc550f485dbef0d180ed27ff0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:49.841254 8640 tablet_service.cc:1467] Processing CreateTablet for tablet 675413dc550f485dbef0d180ed27ff0e (DEFAULT_TABLE table=default.table_116796b0dc6c4dbd97c4f0c519f6d18f [id=0c4867ea1c1e45f388ccd4e2c9de093e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:49.841759 8640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 675413dc550f485dbef0d180ed27ff0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:49.844928 8641 tablet_service.cc:1514] Processing DeleteTablet for tablet 514af46a4b0c4c2f8e27b65a1322e976 with delete_type TABLET_DATA_DELETED (replaced by tablet bdd71e7f271c40d4b722f38d32b1ea1d) from {username='slave'} at 127.0.0.1:52276
I20260620 14:47:49.846683 8780 tablet_service.cc:1467] Processing CreateTablet for tablet bd541e6a431348c7a506611681730fc5 (DEFAULT_TABLE table=default.table_b702c9d170e842fa824a76fb4be199fb [id=c65e926af55d4fbba6c42f4d2ddbb397]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:49.847095 8780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd541e6a431348c7a506611681730fc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:49.853940 8778 tablet_service.cc:1514] Processing DeleteTablet for tablet 514af46a4b0c4c2f8e27b65a1322e976 with delete_type TABLET_DATA_DELETED (replaced by tablet bdd71e7f271c40d4b722f38d32b1ea1d) from {username='slave'} at 127.0.0.1:49700
I20260620 14:47:49.854375 8777 tablet_service.cc:1467] Processing CreateTablet for tablet bdd71e7f271c40d4b722f38d32b1ea1d (DEFAULT_TABLE table=default.table_0210e4215f5f4663af08e8f4da05f3b3 [id=9c1e21a6c9244efba2e86bfa28264a0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:49.854419 8915 tablet_service.cc:1514] Processing DeleteTablet for tablet 514af46a4b0c4c2f8e27b65a1322e976 with delete_type TABLET_DATA_DELETED (replaced by tablet bdd71e7f271c40d4b722f38d32b1ea1d) from {username='slave'} at 127.0.0.1:56438
I20260620 14:47:49.854899 8777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdd71e7f271c40d4b722f38d32b1ea1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:49.854846 8912 tablet_service.cc:1467] Processing CreateTablet for tablet bdd71e7f271c40d4b722f38d32b1ea1d (DEFAULT_TABLE table=default.table_0210e4215f5f4663af08e8f4da05f3b3 [id=9c1e21a6c9244efba2e86bfa28264a0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:49.855298 8912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdd71e7f271c40d4b722f38d32b1ea1d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 14:47:49.858850 8316 catalog_manager.cc:4821] TS 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): delete failed for tablet 514af46a4b0c4c2f8e27b65a1322e976 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 514af46a4b0c4c2f8e27b65a1322e976 already in progress: creating tablet
W20260620 14:47:49.860035 8316 catalog_manager.cc:4821] TS c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821): delete failed for tablet 4d3010d65aa944798b48df808633bc15 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d3010d65aa944798b48df808633bc15 already in progress: creating tablet
W20260620 14:47:49.860302 8316 catalog_manager.cc:4821] TS c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821): delete failed for tablet b687f0fcc5bf46b49ea3705872c6af70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b687f0fcc5bf46b49ea3705872c6af70 already in progress: creating tablet
W20260620 14:47:49.860532 8316 catalog_manager.cc:4821] TS c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821): delete failed for tablet 514af46a4b0c4c2f8e27b65a1322e976 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 514af46a4b0c4c2f8e27b65a1322e976 already in progress: creating tablet
I20260620 14:47:49.863051 9048 tablet_bootstrap.cc:492] T 514af46a4b0c4c2f8e27b65a1322e976 P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:49.863233 9048 ts_tablet_manager.cc:1397] T 514af46a4b0c4c2f8e27b65a1322e976 P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.085s user 0.008s sys 0.006s
I20260620 14:47:49.863580 9049 ts_tablet_manager.cc:1428] T 4d3010d65aa944798b48df808633bc15 P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.166s user 0.053s sys 0.060s
I20260620 14:47:49.866627 8914 tablet_service.cc:1467] Processing CreateTablet for tablet bd541e6a431348c7a506611681730fc5 (DEFAULT_TABLE table=default.table_b702c9d170e842fa824a76fb4be199fb [id=c65e926af55d4fbba6c42f4d2ddbb397]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:49.867084 8914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd541e6a431348c7a506611681730fc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:49.867493 8641 tablet_service.cc:1467] Processing CreateTablet for tablet bdd71e7f271c40d4b722f38d32b1ea1d (DEFAULT_TABLE table=default.table_0210e4215f5f4663af08e8f4da05f3b3 [id=9c1e21a6c9244efba2e86bfa28264a0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:49.864068 9048 raft_consensus.cc:348] T 514af46a4b0c4c2f8e27b65a1322e976 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:49.867899 8641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdd71e7f271c40d4b722f38d32b1ea1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:49.868180 9048 raft_consensus.cc:374] T 514af46a4b0c4c2f8e27b65a1322e976 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:49.868367 9049 tablet_bootstrap.cc:492] T b687f0fcc5bf46b49ea3705872c6af70 P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:49.870749 9048 raft_consensus.cc:729] T 514af46a4b0c4c2f8e27b65a1322e976 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:49.871169 9048 consensus_queue.cc:260] T 514af46a4b0c4c2f8e27b65a1322e976 P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:49.871905 9049 tablet_bootstrap.cc:654] T b687f0fcc5bf46b49ea3705872c6af70 P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:49.874871 9048 ts_tablet_manager.cc:1428] T 514af46a4b0c4c2f8e27b65a1322e976 P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.012s user 0.002s sys 0.001s
I20260620 14:47:49.877723 9048 tablet_bootstrap.cc:492] T 79da710506b745fb8e807b52a9dc54ab P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:49.879314 9048 tablet_bootstrap.cc:654] T 79da710506b745fb8e807b52a9dc54ab P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:49.884624 9051 ts_tablet_manager.cc:1428] T 4d3010d65aa944798b48df808633bc15 P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.181s user 0.025s sys 0.013s
I20260620 14:47:49.885171 9051 tablet_bootstrap.cc:492] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:49.886848 9051 tablet_bootstrap.cc:654] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:49.890739 9049 tablet_bootstrap.cc:492] T b687f0fcc5bf46b49ea3705872c6af70 P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:49.890901 9049 ts_tablet_manager.cc:1397] T b687f0fcc5bf46b49ea3705872c6af70 P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.006s
I20260620 14:47:49.891871 9049 raft_consensus.cc:348] T b687f0fcc5bf46b49ea3705872c6af70 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:49.892103 9049 raft_consensus.cc:374] T b687f0fcc5bf46b49ea3705872c6af70 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:49.892197 9049 raft_consensus.cc:729] T b687f0fcc5bf46b49ea3705872c6af70 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:49.892457 9049 consensus_queue.cc:260] T b687f0fcc5bf46b49ea3705872c6af70 P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:49.893004 9049 ts_tablet_manager.cc:1428] T b687f0fcc5bf46b49ea3705872c6af70 P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260620 14:47:49.894731 9057 ts_tablet_manager.cc:1918] T 4d3010d65aa944798b48df808633bc15 P 36236dd5bd604ba2819038e525a3790c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 14:47:49.895054 9049 tablet_bootstrap.cc:492] T 514af46a4b0c4c2f8e27b65a1322e976 P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:49.895968 9057 log.cc:1196] T 4d3010d65aa944798b48df808633bc15 P 36236dd5bd604ba2819038e525a3790c: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal/wals/4d3010d65aa944798b48df808633bc15
I20260620 14:47:49.897157 9049 tablet_bootstrap.cc:654] T 514af46a4b0c4c2f8e27b65a1322e976 P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:49.897622 9054 raft_consensus.cc:482] T 514af46a4b0c4c2f8e27b65a1322e976 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:49.897851 9054 raft_consensus.cc:504] T 514af46a4b0c4c2f8e27b65a1322e976 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:49.899649 9054 leader_election.cc:288] T 514af46a4b0c4c2f8e27b65a1322e976 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:47:49.907572 9051 tablet_bootstrap.cc:492] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:49.907742 9051 ts_tablet_manager.cc:1397] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.003s
I20260620 14:47:49.909619 9057 ts_tablet_manager.cc:1939] T 4d3010d65aa944798b48df808633bc15 P 36236dd5bd604ba2819038e525a3790c: Deleting consensus metadata
I20260620 14:47:49.910075 9048 tablet_bootstrap.cc:492] T 79da710506b745fb8e807b52a9dc54ab P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:49.910408 9048 ts_tablet_manager.cc:1397] T 79da710506b745fb8e807b52a9dc54ab P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.033s user 0.006s sys 0.001s
I20260620 14:47:49.911281 9048 raft_consensus.cc:348] T 79da710506b745fb8e807b52a9dc54ab P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:49.911590 9048 raft_consensus.cc:374] T 79da710506b745fb8e807b52a9dc54ab P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:49.911737 9048 raft_consensus.cc:729] T 79da710506b745fb8e807b52a9dc54ab P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:49.911998 9048 consensus_queue.cc:260] T 79da710506b745fb8e807b52a9dc54ab P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:49.912606 9057 tablet_replica.cc:330] T b687f0fcc5bf46b49ea3705872c6af70 P 36236dd5bd604ba2819038e525a3790c: stopping tablet replica
I20260620 14:47:49.912433 8662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "514af46a4b0c4c2f8e27b65a1322e976" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:47:49.912922 9057 raft_consensus.cc:2229] T b687f0fcc5bf46b49ea3705872c6af70 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:49.913158 9057 raft_consensus.cc:2258] T b687f0fcc5bf46b49ea3705872c6af70 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:49.913421 8318 catalog_manager.cc:4841] TS 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): tablet 4d3010d65aa944798b48df808633bc15 (table default.table_8e881e3d74304c008c2588c42a082659 [id=98d2e7b647544a97b50827a0cb2799a0]) successfully deleted
W20260620 14:47:49.913666 8733 leader_election.cc:341] T 514af46a4b0c4c2f8e27b65a1322e976 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821): Illegal state: must be running to vote when last-logged opid is not known
I20260620 14:47:49.913893 9051 raft_consensus.cc:348] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:49.912637 9048 ts_tablet_manager.cc:1428] T 79da710506b745fb8e807b52a9dc54ab P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 14:47:49.914932 9051 raft_consensus.cc:374] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:49.915057 9048 tablet_bootstrap.cc:492] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:49.915091 9051 raft_consensus.cc:729] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:49.915517 9051 consensus_queue.cc:260] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:49.916790 9048 tablet_bootstrap.cc:654] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:49.917407 9051 ts_tablet_manager.cc:1428] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260620 14:47:49.917521 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "514af46a4b0c4c2f8e27b65a1322e976" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4" is_pre_election: true
I20260620 14:47:49.917784 9051 tablet_bootstrap.cc:492] T 514af46a4b0c4c2f8e27b65a1322e976 P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
W20260620 14:47:49.920373 8733 leader_election.cc:341] T 514af46a4b0c4c2f8e27b65a1322e976 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260620 14:47:49.920601 8733 leader_election.cc:302] T 514af46a4b0c4c2f8e27b65a1322e976 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c; no voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0
I20260620 14:47:49.921109 9054 raft_consensus.cc:2726] T 514af46a4b0c4c2f8e27b65a1322e976 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 14:47:49.921712 8325 catalog_manager.cc:2148] created HMS catalog entry for table [id=ef56cde5526c4d9eacfbcd58922deed3]
I20260620 14:47:49.921736 9057 ts_tablet_manager.cc:1905] T b687f0fcc5bf46b49ea3705872c6af70 P 36236dd5bd604ba2819038e525a3790c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:49.922384 9051 tablet_bootstrap.cc:654] T 514af46a4b0c4c2f8e27b65a1322e976 P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:49.936209 8914 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d3010d65aa944798b48df808633bc15 with delete_type TABLET_DATA_DELETED (replaced by tablet 1ad679f398ab41a1bc207b016648cbe8) from {username='slave'} at 127.0.0.1:56438
I20260620 14:47:49.936619 9056 tablet_replica.cc:330] T 4d3010d65aa944798b48df808633bc15 P 6c99207e35f8463292d71c371c9546b4: stopping tablet replica
I20260620 14:47:49.937430 9056 raft_consensus.cc:2229] T 4d3010d65aa944798b48df808633bc15 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:49.938012 9056 raft_consensus.cc:2258] T 4d3010d65aa944798b48df808633bc15 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:49.939073 8641 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d3010d65aa944798b48df808633bc15 with delete_type TABLET_DATA_DELETED (replaced by tablet 1ad679f398ab41a1bc207b016648cbe8) from {username='slave'} at 127.0.0.1:52276
I20260620 14:47:49.939510 9055 tablet_replica.cc:330] T 4d3010d65aa944798b48df808633bc15 P c0e6c57ab91e42bf9be3739c816916c0: stopping tablet replica
I20260620 14:47:49.940085 9055 raft_consensus.cc:2229] T 4d3010d65aa944798b48df808633bc15 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:49.940117 9056 ts_tablet_manager.cc:1905] T 4d3010d65aa944798b48df808633bc15 P 6c99207e35f8463292d71c371c9546b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:49.940199 9049 tablet_bootstrap.cc:492] T 514af46a4b0c4c2f8e27b65a1322e976 P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:49.940372 9049 ts_tablet_manager.cc:1397] T 514af46a4b0c4c2f8e27b65a1322e976 P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.045s user 0.014s sys 0.000s
I20260620 14:47:49.940584 9055 raft_consensus.cc:2258] T 4d3010d65aa944798b48df808633bc15 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:49.941257 9049 raft_consensus.cc:348] T 514af46a4b0c4c2f8e27b65a1322e976 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:49.941413 9062 raft_consensus.cc:482] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:49.941501 9049 raft_consensus.cc:374] T 514af46a4b0c4c2f8e27b65a1322e976 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:49.941574 9049 raft_consensus.cc:729] T 514af46a4b0c4c2f8e27b65a1322e976 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:49.941677 9062 raft_consensus.cc:504] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:49.941857 9049 consensus_queue.cc:260] T 514af46a4b0c4c2f8e27b65a1322e976 P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:49.943511 9049 ts_tablet_manager.cc:1428] T 514af46a4b0c4c2f8e27b65a1322e976 P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 14:47:49.943536 9062 leader_election.cc:288] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:49.943816 9049 tablet_bootstrap.cc:492] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:49.945547 9049 tablet_bootstrap.cc:654] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:49.946472 9055 ts_tablet_manager.cc:1905] T 4d3010d65aa944798b48df808633bc15 P c0e6c57ab91e42bf9be3739c816916c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:49.956132 9048 tablet_bootstrap.cc:492] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:49.956321 9048 ts_tablet_manager.cc:1397] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.006s
I20260620 14:47:49.958649 9048 raft_consensus.cc:348] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:49.958918 9048 raft_consensus.cc:374] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:49.958998 9048 raft_consensus.cc:729] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:49.959033 8914 tablet_service.cc:1467] Processing CreateTablet for tablet 77f744b0f04a416099d955dcba1be34a (DEFAULT_TABLE table=default.table_a800f01d336648a8b400cefc457c444d [id=ef56cde5526c4d9eacfbcd58922deed3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:49.959197 9048 consensus_queue.cc:260] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:49.959450 8914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77f744b0f04a416099d955dcba1be34a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:49.959736 9048 ts_tablet_manager.cc:1428] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 14:47:49.962152 9048 tablet_bootstrap.cc:492] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:49.963829 9048 tablet_bootstrap.cc:654] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:49.964684 8641 tablet_service.cc:1467] Processing CreateTablet for tablet 77f744b0f04a416099d955dcba1be34a (DEFAULT_TABLE table=default.table_a800f01d336648a8b400cefc457c444d [id=ef56cde5526c4d9eacfbcd58922deed3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:49.966162 8779 tablet_service.cc:1467] Processing CreateTablet for tablet 77f744b0f04a416099d955dcba1be34a (DEFAULT_TABLE table=default.table_a800f01d336648a8b400cefc457c444d [id=ef56cde5526c4d9eacfbcd58922deed3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:49.966578 8779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77f744b0f04a416099d955dcba1be34a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:49.967960 9056 ts_tablet_manager.cc:1918] T 4d3010d65aa944798b48df808633bc15 P 6c99207e35f8463292d71c371c9546b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 14:47:49.968135 9056 log.cc:1196] T 4d3010d65aa944798b48df808633bc15 P 6c99207e35f8463292d71c371c9546b4: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal/wals/4d3010d65aa944798b48df808633bc15
I20260620 14:47:49.968582 9056 ts_tablet_manager.cc:1939] T 4d3010d65aa944798b48df808633bc15 P 6c99207e35f8463292d71c371c9546b4: Deleting consensus metadata
I20260620 14:47:49.969198 8662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b687f0fcc5bf46b49ea3705872c6af70" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:47:49.969619 8662 raft_consensus.cc:2454] T b687f0fcc5bf46b49ea3705872c6af70 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:49.970331 8869 leader_election.cc:302] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:49.970600 8641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77f744b0f04a416099d955dcba1be34a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260620 14:47:49.970742 8710 tablet.cc:2369] T 514af46a4b0c4c2f8e27b65a1322e976 P c0e6c57ab91e42bf9be3739c816916c0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:47:49.972700 9049 tablet_bootstrap.cc:492] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:49.972867 9049 ts_tablet_manager.cc:1397] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.001s
I20260620 14:47:49.973601 9049 raft_consensus.cc:348] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:49.973847 9049 raft_consensus.cc:374] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:49.973929 9049 raft_consensus.cc:729] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:49.974185 9049 consensus_queue.cc:260] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
W20260620 14:47:49.974840 8733 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.222.195:45279, user_credentials={real_user=slave}} blocked reactor thread for 54474.3us
I20260620 14:47:49.977679 9049 ts_tablet_manager.cc:1428] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260620 14:47:49.978165 9062 raft_consensus.cc:2781] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:49.978758 9062 raft_consensus.cc:482] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:49.978917 9062 raft_consensus.cc:3037] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:49.983219 9055 ts_tablet_manager.cc:1918] T 4d3010d65aa944798b48df808633bc15 P c0e6c57ab91e42bf9be3739c816916c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 14:47:49.983408 9055 log.cc:1196] T 4d3010d65aa944798b48df808633bc15 P c0e6c57ab91e42bf9be3739c816916c0: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/wal/wals/4d3010d65aa944798b48df808633bc15
I20260620 14:47:49.983887 9055 ts_tablet_manager.cc:1939] T 4d3010d65aa944798b48df808633bc15 P c0e6c57ab91e42bf9be3739c816916c0: Deleting consensus metadata
I20260620 14:47:49.985460 9049 tablet_bootstrap.cc:492] T 1ad679f398ab41a1bc207b016648cbe8 P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:49.987342 9049 tablet_bootstrap.cc:654] T 1ad679f398ab41a1bc207b016648cbe8 P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:49.988531 8316 catalog_manager.cc:4841] TS c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821): tablet 4d3010d65aa944798b48df808633bc15 (table default.table_8e881e3d74304c008c2588c42a082659 [id=98d2e7b647544a97b50827a0cb2799a0]) successfully deleted
I20260620 14:47:49.989271 8641 tablet_service.cc:1514] Processing DeleteTablet for tablet b687f0fcc5bf46b49ea3705872c6af70 with delete_type TABLET_DATA_DELETED (replaced by tablet bd541e6a431348c7a506611681730fc5) from {username='slave'} at 127.0.0.1:52276
W20260620 14:47:49.989601 8983 tablet.cc:2369] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260620 14:47:49.992200 9062 raft_consensus.cc:504] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:49.993181 9062 leader_election.cc:288] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Requested vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:49.993561 8662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b687f0fcc5bf46b49ea3705872c6af70" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:47:49.993791 8662 raft_consensus.cc:3037] T b687f0fcc5bf46b49ea3705872c6af70 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:49.997781 8662 raft_consensus.cc:2454] T b687f0fcc5bf46b49ea3705872c6af70 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:49.998274 8869 leader_election.cc:302] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:49.998659 9062 raft_consensus.cc:2781] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:49.999116 8316 catalog_manager.cc:4841] TS 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): tablet 4d3010d65aa944798b48df808633bc15 (table default.table_8e881e3d74304c008c2588c42a082659 [id=98d2e7b647544a97b50827a0cb2799a0]) successfully deleted
I20260620 14:47:49.999681 9055 tablet_replica.cc:330] T b687f0fcc5bf46b49ea3705872c6af70 P c0e6c57ab91e42bf9be3739c816916c0: stopping tablet replica
I20260620 14:47:50.000006 9055 raft_consensus.cc:2229] T b687f0fcc5bf46b49ea3705872c6af70 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:50.000211 9055 raft_consensus.cc:2258] T b687f0fcc5bf46b49ea3705872c6af70 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:50.001077 9055 ts_tablet_manager.cc:1905] T b687f0fcc5bf46b49ea3705872c6af70 P c0e6c57ab91e42bf9be3739c816916c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:50.003839 8641 tablet_service.cc:1514] Processing DeleteTablet for tablet 514af46a4b0c4c2f8e27b65a1322e976 with delete_type TABLET_DATA_DELETED (replaced by tablet bdd71e7f271c40d4b722f38d32b1ea1d) from {username='slave'} at 127.0.0.1:52276
I20260620 14:47:50.005136 9057 ts_tablet_manager.cc:1918] T b687f0fcc5bf46b49ea3705872c6af70 P 36236dd5bd604ba2819038e525a3790c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 14:47:50.005323 9057 log.cc:1196] T b687f0fcc5bf46b49ea3705872c6af70 P 36236dd5bd604ba2819038e525a3790c: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal/wals/b687f0fcc5bf46b49ea3705872c6af70
I20260620 14:47:50.005748 9057 ts_tablet_manager.cc:1939] T b687f0fcc5bf46b49ea3705872c6af70 P 36236dd5bd604ba2819038e525a3790c: Deleting consensus metadata
I20260620 14:47:50.006989 8318 catalog_manager.cc:4841] TS 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): tablet b687f0fcc5bf46b49ea3705872c6af70 (table default.table_b702c9d170e842fa824a76fb4be199fb [id=c65e926af55d4fbba6c42f4d2ddbb397]) successfully deleted
I20260620 14:47:50.010811 8552 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dd308569015348a7a19ba4a560de6d52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:50.011233 8552 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: This master's current role is: LEADER
I20260620 14:47:50.014528 9062 raft_consensus.cc:686] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Becoming Leader. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Running, Role: LEADER
I20260620 14:47:50.017045 8914 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d3010d65aa944798b48df808633bc15 with delete_type TABLET_DATA_DELETED (replaced by tablet 1ad679f398ab41a1bc207b016648cbe8) from {username='slave'} at 127.0.0.1:56438
W20260620 14:47:50.017812 8871 leader_election.cc:341] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: b687f0fcc5bf46b49ea3705872c6af70
W20260620 14:47:50.017997 8316 catalog_manager.cc:4808] TS 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): delete failed for tablet 4d3010d65aa944798b48df808633bc15 because the tablet was not found. No further retry: Not found: Tablet not found: 4d3010d65aa944798b48df808633bc15
W20260620 14:47:50.018411 8871 leader_election.cc:341] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: b687f0fcc5bf46b49ea3705872c6af70
I20260620 14:47:50.017107 9062 consensus_queue.cc:237] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.020368 8914 tablet_service.cc:1514] Processing DeleteTablet for tablet b687f0fcc5bf46b49ea3705872c6af70 with delete_type TABLET_DATA_DELETED (replaced by tablet bd541e6a431348c7a506611681730fc5) from {username='slave'} at 127.0.0.1:56438
I20260620 14:47:50.020709 9056 tablet_replica.cc:330] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4: stopping tablet replica
I20260620 14:47:50.022661 8325 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59860:
name: "default.Table_fdbead99862d49af98df44683e830bf5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:50.026711 9048 tablet_bootstrap.cc:492] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:50.026892 9048 ts_tablet_manager.cc:1397] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.065s user 0.000s sys 0.019s
I20260620 14:47:50.027299 9051 tablet_bootstrap.cc:492] T 514af46a4b0c4c2f8e27b65a1322e976 P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:50.027504 9051 ts_tablet_manager.cc:1397] T 514af46a4b0c4c2f8e27b65a1322e976 P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.110s user 0.025s sys 0.030s
I20260620 14:47:50.027707 9048 raft_consensus.cc:348] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.027943 9048 raft_consensus.cc:374] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.028052 9048 raft_consensus.cc:729] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.028311 9048 consensus_queue.cc:260] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.028406 9051 raft_consensus.cc:348] T 514af46a4b0c4c2f8e27b65a1322e976 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.028697 9051 raft_consensus.cc:374] T 514af46a4b0c4c2f8e27b65a1322e976 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.028812 9051 raft_consensus.cc:729] T 514af46a4b0c4c2f8e27b65a1322e976 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.029116 9051 consensus_queue.cc:260] T 514af46a4b0c4c2f8e27b65a1322e976 P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.029748 9057 tablet_replica.cc:330] T 514af46a4b0c4c2f8e27b65a1322e976 P 36236dd5bd604ba2819038e525a3790c: stopping tablet replica
I20260620 14:47:50.029942 9057 raft_consensus.cc:2229] T 514af46a4b0c4c2f8e27b65a1322e976 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:50.030134 9057 raft_consensus.cc:2258] T 514af46a4b0c4c2f8e27b65a1322e976 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:50.031034 9051 ts_tablet_manager.cc:1428] T 514af46a4b0c4c2f8e27b65a1322e976 P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 14:47:50.031903 9049 tablet_bootstrap.cc:492] T 1ad679f398ab41a1bc207b016648cbe8 P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:50.032099 9049 ts_tablet_manager.cc:1397] T 1ad679f398ab41a1bc207b016648cbe8 P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.047s user 0.007s sys 0.015s
I20260620 14:47:50.032418 9051 tablet_bootstrap.cc:492] T 79da710506b745fb8e807b52a9dc54ab P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:50.032778 9048 ts_tablet_manager.cc:1428] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260620 14:47:50.032940 9049 raft_consensus.cc:348] T 1ad679f398ab41a1bc207b016648cbe8 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.033188 9049 raft_consensus.cc:374] T 1ad679f398ab41a1bc207b016648cbe8 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.033273 9049 raft_consensus.cc:729] T 1ad679f398ab41a1bc207b016648cbe8 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.033519 9049 consensus_queue.cc:260] T 1ad679f398ab41a1bc207b016648cbe8 P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.034022 9049 ts_tablet_manager.cc:1428] T 1ad679f398ab41a1bc207b016648cbe8 P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 14:47:50.034648 9051 tablet_bootstrap.cc:654] T 79da710506b745fb8e807b52a9dc54ab P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:50.036623 9057 ts_tablet_manager.cc:1905] T 514af46a4b0c4c2f8e27b65a1322e976 P 36236dd5bd604ba2819038e525a3790c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:50.037554 9048 tablet_bootstrap.cc:492] T bd541e6a431348c7a506611681730fc5 P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:50.039331 9048 tablet_bootstrap.cc:654] T bd541e6a431348c7a506611681730fc5 P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:50.043251 9051 tablet_bootstrap.cc:492] T 79da710506b745fb8e807b52a9dc54ab P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:50.043432 9051 ts_tablet_manager.cc:1397] T 79da710506b745fb8e807b52a9dc54ab P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.006s
I20260620 14:47:50.043469 9049 tablet_bootstrap.cc:492] T bd541e6a431348c7a506611681730fc5 P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:50.044355 9051 raft_consensus.cc:348] T 79da710506b745fb8e807b52a9dc54ab P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.044693 9051 raft_consensus.cc:374] T 79da710506b745fb8e807b52a9dc54ab P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.044808 9051 raft_consensus.cc:729] T 79da710506b745fb8e807b52a9dc54ab P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.045131 9051 consensus_queue.cc:260] T 79da710506b745fb8e807b52a9dc54ab P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.046993 9051 ts_tablet_manager.cc:1428] T 79da710506b745fb8e807b52a9dc54ab P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260620 14:47:50.048105 9055 ts_tablet_manager.cc:1918] T b687f0fcc5bf46b49ea3705872c6af70 P c0e6c57ab91e42bf9be3739c816916c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 14:47:50.048260 9055 log.cc:1196] T b687f0fcc5bf46b49ea3705872c6af70 P c0e6c57ab91e42bf9be3739c816916c0: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/wal/wals/b687f0fcc5bf46b49ea3705872c6af70
I20260620 14:47:50.048341 9051 tablet_bootstrap.cc:492] T 675413dc550f485dbef0d180ed27ff0e P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:50.048635 9055 ts_tablet_manager.cc:1939] T b687f0fcc5bf46b49ea3705872c6af70 P c0e6c57ab91e42bf9be3739c816916c0: Deleting consensus metadata
I20260620 14:47:50.048976 9048 tablet_bootstrap.cc:492] T bd541e6a431348c7a506611681730fc5 P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:50.049139 9048 ts_tablet_manager.cc:1397] T bd541e6a431348c7a506611681730fc5 P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.009s
I20260620 14:47:50.049906 9048 raft_consensus.cc:348] T bd541e6a431348c7a506611681730fc5 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.050166 9048 raft_consensus.cc:374] T bd541e6a431348c7a506611681730fc5 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.050239 9048 raft_consensus.cc:729] T bd541e6a431348c7a506611681730fc5 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.050521 9051 tablet_bootstrap.cc:654] T 675413dc550f485dbef0d180ed27ff0e P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:50.050484 9048 consensus_queue.cc:260] T bd541e6a431348c7a506611681730fc5 P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.051461 8059 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9VKlbC/build/asan/bin/kudu
/tmp/dist-test-task9VKlbC/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.222.253:34209
--webserver_interface=127.7.222.253
--webserver_port=40901
--builtin_ntp_servers=127.7.222.212:42755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--hive_metastore_uris=thrift://127.0.0.1:42797
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260620 14:47:50.054044 9048 ts_tablet_manager.cc:1428] T bd541e6a431348c7a506611681730fc5 P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260620 14:47:50.056874 9048 tablet_bootstrap.cc:492] T 675413dc550f485dbef0d180ed27ff0e P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:50.058478 9048 tablet_bootstrap.cc:654] T 675413dc550f485dbef0d180ed27ff0e P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:50.061297 9049 tablet_bootstrap.cc:654] T bd541e6a431348c7a506611681730fc5 P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:50.061419 8316 catalog_manager.cc:4841] TS c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821): tablet b687f0fcc5bf46b49ea3705872c6af70 (table default.table_b702c9d170e842fa824a76fb4be199fb [id=c65e926af55d4fbba6c42f4d2ddbb397]) successfully deleted
I20260620 14:47:50.064473 9056 raft_consensus.cc:2229] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:47:50.065232 9048 tablet_bootstrap.cc:492] T 675413dc550f485dbef0d180ed27ff0e P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:50.065380 9056 pending_rounds.cc:62] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4: Trying to abort 1 pending ops.
I20260620 14:47:50.065413 9048 ts_tablet_manager.cc:1397] T 675413dc550f485dbef0d180ed27ff0e P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260620 14:47:50.065531 9056 pending_rounds.cc:68] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298936299615784960 op_type: NO_OP noop_request { }
I20260620 14:47:50.065745 9056 raft_consensus.cc:2866] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 14:47:50.065877 9056 raft_consensus.cc:2258] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:50.066150 9055 tablet_replica.cc:330] T 514af46a4b0c4c2f8e27b65a1322e976 P c0e6c57ab91e42bf9be3739c816916c0: stopping tablet replica
I20260620 14:47:50.066321 9055 raft_consensus.cc:2229] T 514af46a4b0c4c2f8e27b65a1322e976 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:50.066380 9048 raft_consensus.cc:348] T 675413dc550f485dbef0d180ed27ff0e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.066545 9055 raft_consensus.cc:2258] T 514af46a4b0c4c2f8e27b65a1322e976 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:50.066581 9048 raft_consensus.cc:374] T 675413dc550f485dbef0d180ed27ff0e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.066668 9048 raft_consensus.cc:729] T 675413dc550f485dbef0d180ed27ff0e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.066866 9048 consensus_queue.cc:260] T 675413dc550f485dbef0d180ed27ff0e P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.067342 9055 ts_tablet_manager.cc:1905] T 514af46a4b0c4c2f8e27b65a1322e976 P c0e6c57ab91e42bf9be3739c816916c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:50.067569 9048 ts_tablet_manager.cc:1428] T 675413dc550f485dbef0d180ed27ff0e P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260620 14:47:50.067850 9048 tablet_bootstrap.cc:492] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:50.069548 9048 tablet_bootstrap.cc:654] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:50.070164 9057 ts_tablet_manager.cc:1918] T 514af46a4b0c4c2f8e27b65a1322e976 P 36236dd5bd604ba2819038e525a3790c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 14:47:50.070313 9057 log.cc:1196] T 514af46a4b0c4c2f8e27b65a1322e976 P 36236dd5bd604ba2819038e525a3790c: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal/wals/514af46a4b0c4c2f8e27b65a1322e976
I20260620 14:47:50.071630 9051 tablet_bootstrap.cc:492] T 675413dc550f485dbef0d180ed27ff0e P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:50.071789 9051 ts_tablet_manager.cc:1397] T 675413dc550f485dbef0d180ed27ff0e P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.002s
I20260620 14:47:50.071847 9057 ts_tablet_manager.cc:1939] T 514af46a4b0c4c2f8e27b65a1322e976 P 36236dd5bd604ba2819038e525a3790c: Deleting consensus metadata
I20260620 14:47:50.072530 9051 raft_consensus.cc:348] T 675413dc550f485dbef0d180ed27ff0e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.072779 9051 raft_consensus.cc:374] T 675413dc550f485dbef0d180ed27ff0e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.072856 9051 raft_consensus.cc:729] T 675413dc550f485dbef0d180ed27ff0e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.072886 8318 catalog_manager.cc:4841] TS 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): tablet 514af46a4b0c4c2f8e27b65a1322e976 (table default.table_0210e4215f5f4663af08e8f4da05f3b3 [id=9c1e21a6c9244efba2e86bfa28264a0d]) successfully deleted
I20260620 14:47:50.073108 9051 consensus_queue.cc:260] T 675413dc550f485dbef0d180ed27ff0e P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.074627 9056 ts_tablet_manager.cc:1905] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:50.074666 9051 ts_tablet_manager.cc:1428] T 675413dc550f485dbef0d180ed27ff0e P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 14:47:50.076193 9048 tablet_bootstrap.cc:492] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:50.076406 9048 ts_tablet_manager.cc:1397] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260620 14:47:50.077592 9051 tablet_bootstrap.cc:492] T 1ad679f398ab41a1bc207b016648cbe8 P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:50.078137 9048 raft_consensus.cc:348] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.078456 9048 raft_consensus.cc:374] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.078579 9048 raft_consensus.cc:729] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.078886 9048 consensus_queue.cc:260] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.079241 9051 tablet_bootstrap.cc:654] T 1ad679f398ab41a1bc207b016648cbe8 P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:50.079582 9048 ts_tablet_manager.cc:1428] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 14:47:50.085031 9049 tablet_bootstrap.cc:492] T bd541e6a431348c7a506611681730fc5 P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:50.085199 9049 ts_tablet_manager.cc:1397] T bd541e6a431348c7a506611681730fc5 P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.042s user 0.005s sys 0.007s
I20260620 14:47:50.087455 9049 raft_consensus.cc:348] T bd541e6a431348c7a506611681730fc5 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.087752 9049 raft_consensus.cc:374] T bd541e6a431348c7a506611681730fc5 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.087859 9049 raft_consensus.cc:729] T bd541e6a431348c7a506611681730fc5 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.088151 9049 consensus_queue.cc:260] T bd541e6a431348c7a506611681730fc5 P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.088465 9055 ts_tablet_manager.cc:1918] T 514af46a4b0c4c2f8e27b65a1322e976 P c0e6c57ab91e42bf9be3739c816916c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 14:47:50.088615 9055 log.cc:1196] T 514af46a4b0c4c2f8e27b65a1322e976 P c0e6c57ab91e42bf9be3739c816916c0: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/wal/wals/514af46a4b0c4c2f8e27b65a1322e976
I20260620 14:47:50.089037 9055 ts_tablet_manager.cc:1939] T 514af46a4b0c4c2f8e27b65a1322e976 P c0e6c57ab91e42bf9be3739c816916c0: Deleting consensus metadata
I20260620 14:47:50.089035 9056 ts_tablet_manager.cc:1918] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:50.089151 9056 log.cc:1196] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal/wals/b687f0fcc5bf46b49ea3705872c6af70
I20260620 14:47:50.089570 9056 ts_tablet_manager.cc:1939] T b687f0fcc5bf46b49ea3705872c6af70 P 6c99207e35f8463292d71c371c9546b4: Deleting consensus metadata
I20260620 14:47:50.090655 8316 catalog_manager.cc:4841] TS c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821): tablet 514af46a4b0c4c2f8e27b65a1322e976 (table default.table_0210e4215f5f4663af08e8f4da05f3b3 [id=9c1e21a6c9244efba2e86bfa28264a0d]) successfully deleted
I20260620 14:47:50.090962 8316 catalog_manager.cc:4841] TS 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): tablet b687f0fcc5bf46b49ea3705872c6af70 (table default.table_b702c9d170e842fa824a76fb4be199fb [id=c65e926af55d4fbba6c42f4d2ddbb397]) successfully deleted
I20260620 14:47:50.096573 9049 ts_tablet_manager.cc:1428] T bd541e6a431348c7a506611681730fc5 P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260620 14:47:50.096997 9049 tablet_bootstrap.cc:492] T 675413dc550f485dbef0d180ed27ff0e P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:50.098863 9049 tablet_bootstrap.cc:654] T 675413dc550f485dbef0d180ed27ff0e P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:50.099092 9051 tablet_bootstrap.cc:492] T 1ad679f398ab41a1bc207b016648cbe8 P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:50.099260 9051 ts_tablet_manager.cc:1397] T 1ad679f398ab41a1bc207b016648cbe8 P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.002s
I20260620 14:47:50.100031 9051 raft_consensus.cc:348] T 1ad679f398ab41a1bc207b016648cbe8 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.100281 9051 raft_consensus.cc:374] T 1ad679f398ab41a1bc207b016648cbe8 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.100368 9051 raft_consensus.cc:729] T 1ad679f398ab41a1bc207b016648cbe8 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.100641 9051 consensus_queue.cc:260] T 1ad679f398ab41a1bc207b016648cbe8 P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.102751 9051 ts_tablet_manager.cc:1428] T 1ad679f398ab41a1bc207b016648cbe8 P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 14:47:50.103325 9051 tablet_bootstrap.cc:492] T bdd71e7f271c40d4b722f38d32b1ea1d P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:50.105018 9051 tablet_bootstrap.cc:654] T bdd71e7f271c40d4b722f38d32b1ea1d P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:50.108667 9049 tablet_bootstrap.cc:492] T 675413dc550f485dbef0d180ed27ff0e P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:50.108868 9049 ts_tablet_manager.cc:1397] T 675413dc550f485dbef0d180ed27ff0e P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260620 14:47:50.109632 9049 raft_consensus.cc:348] T 675413dc550f485dbef0d180ed27ff0e P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.109898 9049 raft_consensus.cc:374] T 675413dc550f485dbef0d180ed27ff0e P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.109985 9049 raft_consensus.cc:729] T 675413dc550f485dbef0d180ed27ff0e P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.110240 9049 consensus_queue.cc:260] T 675413dc550f485dbef0d180ed27ff0e P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.112418 9049 ts_tablet_manager.cc:1428] T 675413dc550f485dbef0d180ed27ff0e P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 14:47:50.112707 9049 tablet_bootstrap.cc:492] T bdd71e7f271c40d4b722f38d32b1ea1d P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:50.113518 9051 tablet_bootstrap.cc:492] T bdd71e7f271c40d4b722f38d32b1ea1d P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:50.113680 9051 ts_tablet_manager.cc:1397] T bdd71e7f271c40d4b722f38d32b1ea1d P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260620 14:47:50.114241 9049 tablet_bootstrap.cc:654] T bdd71e7f271c40d4b722f38d32b1ea1d P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:50.114490 9051 raft_consensus.cc:348] T bdd71e7f271c40d4b722f38d32b1ea1d P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.114739 9051 raft_consensus.cc:374] T bdd71e7f271c40d4b722f38d32b1ea1d P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.114825 9051 raft_consensus.cc:729] T bdd71e7f271c40d4b722f38d32b1ea1d P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.115078 9051 consensus_queue.cc:260] T bdd71e7f271c40d4b722f38d32b1ea1d P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.116775 9051 ts_tablet_manager.cc:1428] T bdd71e7f271c40d4b722f38d32b1ea1d P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 14:47:50.117056 9051 tablet_bootstrap.cc:492] T bd541e6a431348c7a506611681730fc5 P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:50.118747 9051 tablet_bootstrap.cc:654] T bd541e6a431348c7a506611681730fc5 P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:50.121866 9049 tablet_bootstrap.cc:492] T bdd71e7f271c40d4b722f38d32b1ea1d P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:50.121987 9051 tablet_bootstrap.cc:492] T bd541e6a431348c7a506611681730fc5 P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:50.122118 9051 ts_tablet_manager.cc:1397] T bd541e6a431348c7a506611681730fc5 P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260620 14:47:50.122217 9049 ts_tablet_manager.cc:1397] T bdd71e7f271c40d4b722f38d32b1ea1d P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20260620 14:47:50.122975 9051 raft_consensus.cc:348] T bd541e6a431348c7a506611681730fc5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.122967 9049 raft_consensus.cc:348] T bdd71e7f271c40d4b722f38d32b1ea1d P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.123199 9051 raft_consensus.cc:374] T bd541e6a431348c7a506611681730fc5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.123284 9051 raft_consensus.cc:729] T bd541e6a431348c7a506611681730fc5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.123320 9049 raft_consensus.cc:374] T bdd71e7f271c40d4b722f38d32b1ea1d P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.123500 9049 raft_consensus.cc:729] T bdd71e7f271c40d4b722f38d32b1ea1d P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.123554 9051 consensus_queue.cc:260] T bd541e6a431348c7a506611681730fc5 P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.123768 9049 consensus_queue.cc:260] T bdd71e7f271c40d4b722f38d32b1ea1d P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.124459 9049 ts_tablet_manager.cc:1428] T bdd71e7f271c40d4b722f38d32b1ea1d P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 14:47:50.124845 9049 tablet_bootstrap.cc:492] T 77f744b0f04a416099d955dcba1be34a P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:50.126534 9049 tablet_bootstrap.cc:654] T 77f744b0f04a416099d955dcba1be34a P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:50.127147 9051 ts_tablet_manager.cc:1428] T bd541e6a431348c7a506611681730fc5 P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260620 14:47:50.130839 9051 tablet_bootstrap.cc:492] T 77f744b0f04a416099d955dcba1be34a P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:50.132347 8327 catalog_manager.cc:2148] created HMS catalog entry for table [id=15e21d8b3d5644f8ac2112c1dd37e7ff]
I20260620 14:47:50.132843 9051 tablet_bootstrap.cc:654] T 77f744b0f04a416099d955dcba1be34a P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:50.139065 8327 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:59860 (request call id 5) took 1080 ms. Trace:
I20260620 14:47:50.139933 9051 tablet_bootstrap.cc:492] T 77f744b0f04a416099d955dcba1be34a P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:50.140106 9051 ts_tablet_manager.cc:1397] T 77f744b0f04a416099d955dcba1be34a P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260620 14:47:50.139259 8327 rpcz_store.cc:276] 0620 14:47:49.058089 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:49.058605 (+ 516us) service_pool.cc:227] Handling call
0620 14:47:49.491178 (+432573us) catalog_manager.cc:2075] Acquired catalog manager lock
0620 14:47:49.491738 (+ 560us) catalog_manager.cc:2121] Created new table and tablet info
0620 14:47:50.132295 (+640557us) catalog_manager.cc:2147] Created new table in HMS catalog
0620 14:47:50.138755 (+ 6460us) catalog_manager.cc:2181] Wrote table and tablets to system table
0620 14:47:50.138914 (+ 159us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0620 14:47:50.139016 (+ 102us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 14:47:50.133074 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 14:47:50.133183 (+ 109us) write_op.cc:432] Acquiring schema lock in shared mode
0620 14:47:50.133190 (+ 7us) write_op.cc:435] Acquired schema lock
0620 14:47:50.133192 (+ 2us) tablet.cc:660] Decoding operations
0620 14:47:50.133288 (+ 96us) write_op.cc:620] Acquiring the partition lock for write op
0620 14:47:50.133303 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0620 14:47:50.133308 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0620 14:47:50.133400 (+ 92us) tablet.cc:699] Row locks acquired
0620 14:47:50.133402 (+ 2us) write_op.cc:260] PREPARE: finished
0620 14:47:50.133446 (+ 44us) write_op.cc:270] Start()
0620 14:47:50.133484 (+ 38us) write_op.cc:276] Timestamp: P: 1781966870133404 usec, L: 0
0620 14:47:50.133487 (+ 3us) op_driver.cc:331] REPLICATION: starting
0620 14:47:50.133692 (+ 205us) log.cc:842] Serialized 432 byte log entry
0620 14:47:50.137391 (+ 3699us) op_driver.cc:444] REPLICATION: finished
0620 14:47:50.137526 (+ 135us) write_op.cc:301] APPLY: starting
0620 14:47:50.137545 (+ 19us) tablet.cc:1365] starting BulkCheckPresence
0620 14:47:50.137594 (+ 49us) tablet.cc:1368] finished BulkCheckPresence
0620 14:47:50.137620 (+ 26us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 14:47:50.137743 (+ 123us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 14:47:50.137784 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0620 14:47:50.137789 (+ 5us) write_op.cc:312] APPLY: finished
0620 14:47:50.137888 (+ 99us) log.cc:842] Serialized 28 byte log entry
0620 14:47:50.137955 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0620 14:47:50.137976 (+ 21us) write_op.cc:454] Released schema lock
0620 14:47:50.137982 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0620 14:47:50.138040 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0620 14:47:50.138043 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":429575,"Hive Metastore.run_cpu_time_us":280,"Hive Metastore.run_wall_time_us":210554,"child_traces":[["op",{"apply.queue_time_us":86,"apply.run_cpu_time_us":588,"apply.run_wall_time_us":587,"num_ops":2,"prepare.queue_time_us":58,"prepare.run_cpu_time_us":735,"prepare.run_wall_time_us":736,"raft.queue_time_us":1173,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":250,"replication_time_us":3877}]]}
I20260620 14:47:50.140869 9051 raft_consensus.cc:348] T 77f744b0f04a416099d955dcba1be34a P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.141115 9051 raft_consensus.cc:374] T 77f744b0f04a416099d955dcba1be34a P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.141188 9051 raft_consensus.cc:729] T 77f744b0f04a416099d955dcba1be34a P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.141434 9051 consensus_queue.cc:260] T 77f744b0f04a416099d955dcba1be34a P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.141611 9049 tablet_bootstrap.cc:492] T 77f744b0f04a416099d955dcba1be34a P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:50.141783 9049 ts_tablet_manager.cc:1397] T 77f744b0f04a416099d955dcba1be34a P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.002s
I20260620 14:47:50.142027 9051 ts_tablet_manager.cc:1428] T 77f744b0f04a416099d955dcba1be34a P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 14:47:50.142463 9049 raft_consensus.cc:348] T 77f744b0f04a416099d955dcba1be34a P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.142714 9049 raft_consensus.cc:374] T 77f744b0f04a416099d955dcba1be34a P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.142798 9049 raft_consensus.cc:729] T 77f744b0f04a416099d955dcba1be34a P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.143018 9049 consensus_queue.cc:260] T 77f744b0f04a416099d955dcba1be34a P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.143553 9049 ts_tablet_manager.cc:1428] T 77f744b0f04a416099d955dcba1be34a P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 14:47:50.153437 8914 tablet_service.cc:1467] Processing CreateTablet for tablet 235446b4e9324eab836718837a0de8d5 (DEFAULT_TABLE table=default.table_1d0410429a7242ab85d16d800ffd0502 [id=15e21d8b3d5644f8ac2112c1dd37e7ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:50.153923 8914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 235446b4e9324eab836718837a0de8d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:50.157414 8641 tablet_service.cc:1467] Processing CreateTablet for tablet 235446b4e9324eab836718837a0de8d5 (DEFAULT_TABLE table=default.table_1d0410429a7242ab85d16d800ffd0502 [id=15e21d8b3d5644f8ac2112c1dd37e7ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:50.157888 8641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 235446b4e9324eab836718837a0de8d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:50.161811 8779 tablet_service.cc:1467] Processing CreateTablet for tablet 235446b4e9324eab836718837a0de8d5 (DEFAULT_TABLE table=default.table_1d0410429a7242ab85d16d800ffd0502 [id=15e21d8b3d5644f8ac2112c1dd37e7ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:50.162314 8779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 235446b4e9324eab836718837a0de8d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:50.173040 8326 catalog_manager.cc:2148] created HMS catalog entry for table [id=7f9c4b4af7614d20b0e5ddfbf7d2b0f5]
I20260620 14:47:50.176538 9051 tablet_bootstrap.cc:492] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:50.178254 9051 tablet_bootstrap.cc:654] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:50.179628 8326 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:59860 (request call id 6) took 1121 ms. Trace:
I20260620 14:47:50.179759 8326 rpcz_store.cc:276] 0620 14:47:49.058213 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:49.058630 (+ 417us) service_pool.cc:227] Handling call
0620 14:47:49.492319 (+433689us) catalog_manager.cc:2075] Acquired catalog manager lock
0620 14:47:49.495692 (+ 3373us) catalog_manager.cc:2121] Created new table and tablet info
0620 14:47:50.172980 (+677288us) catalog_manager.cc:2147] Created new table in HMS catalog
0620 14:47:50.179397 (+ 6417us) catalog_manager.cc:2181] Wrote table and tablets to system table
0620 14:47:50.179507 (+ 110us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0620 14:47:50.179590 (+ 83us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 14:47:50.173892 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 14:47:50.174013 (+ 121us) write_op.cc:432] Acquiring schema lock in shared mode
0620 14:47:50.174020 (+ 7us) write_op.cc:435] Acquired schema lock
0620 14:47:50.174022 (+ 2us) tablet.cc:660] Decoding operations
0620 14:47:50.174122 (+ 100us) write_op.cc:620] Acquiring the partition lock for write op
0620 14:47:50.174135 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0620 14:47:50.174140 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0620 14:47:50.174225 (+ 85us) tablet.cc:699] Row locks acquired
0620 14:47:50.174227 (+ 2us) write_op.cc:260] PREPARE: finished
0620 14:47:50.174266 (+ 39us) write_op.cc:270] Start()
0620 14:47:50.174305 (+ 39us) write_op.cc:276] Timestamp: P: 1781966870174220 usec, L: 0
0620 14:47:50.174309 (+ 4us) op_driver.cc:331] REPLICATION: starting
0620 14:47:50.174496 (+ 187us) log.cc:842] Serialized 432 byte log entry
0620 14:47:50.178510 (+ 4014us) op_driver.cc:444] REPLICATION: finished
0620 14:47:50.178772 (+ 262us) write_op.cc:301] APPLY: starting
0620 14:47:50.178790 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
0620 14:47:50.178834 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0620 14:47:50.178852 (+ 18us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 14:47:50.178970 (+ 118us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 14:47:50.179025 (+ 55us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0620 14:47:50.179031 (+ 6us) write_op.cc:312] APPLY: finished
0620 14:47:50.179110 (+ 79us) log.cc:842] Serialized 28 byte log entry
0620 14:47:50.179174 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0620 14:47:50.179194 (+ 20us) write_op.cc:454] Released schema lock
0620 14:47:50.179200 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0620 14:47:50.179253 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0620 14:47:50.179258 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":636231,"Hive Metastore.run_cpu_time_us":273,"Hive Metastore.run_wall_time_us":40867,"child_traces":[["op",{"apply.queue_time_us":197,"apply.run_cpu_time_us":544,"apply.run_wall_time_us":544,"num_ops":2,"prepare.queue_time_us":146,"prepare.run_cpu_time_us":757,"prepare.run_wall_time_us":757,"raft.queue_time_us":435,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":247,"replication_time_us":4180}]]}
I20260620 14:47:50.182677 8327 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59860:
table { table_name: "default.Table_116796b0dc6c4dbd97c4f0c519f6d18f" } new_table_name: "default.Table_4ab72ecdb6d540508f6f4b250020b540" modify_external_catalogs: true
I20260620 14:47:50.183715 9049 tablet_bootstrap.cc:492] T 235446b4e9324eab836718837a0de8d5 P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:50.185451 9049 tablet_bootstrap.cc:654] T 235446b4e9324eab836718837a0de8d5 P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:50.194664 9077 raft_consensus.cc:482] T 675413dc550f485dbef0d180ed27ff0e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:50.194892 9077 raft_consensus.cc:504] T 675413dc550f485dbef0d180ed27ff0e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.195704 9077 leader_election.cc:288] T 675413dc550f485dbef0d180ed27ff0e P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:50.196422 8800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "675413dc550f485dbef0d180ed27ff0e" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:47:50.197190 8662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "675413dc550f485dbef0d180ed27ff0e" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:47:50.197420 8662 raft_consensus.cc:2454] T 675413dc550f485dbef0d180ed27ff0e P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:50.197952 8869 leader_election.cc:302] T 675413dc550f485dbef0d180ed27ff0e P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:50.198167 9051 tablet_bootstrap.cc:492] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:50.198312 9051 ts_tablet_manager.cc:1397] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.022s user 0.012s sys 0.002s
I20260620 14:47:50.198336 8800 raft_consensus.cc:2454] T 675413dc550f485dbef0d180ed27ff0e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:50.198799 9077 raft_consensus.cc:2781] T 675413dc550f485dbef0d180ed27ff0e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:50.198935 9077 raft_consensus.cc:482] T 675413dc550f485dbef0d180ed27ff0e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:50.199025 9077 raft_consensus.cc:3037] T 675413dc550f485dbef0d180ed27ff0e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.199347 9051 raft_consensus.cc:348] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.199570 9051 raft_consensus.cc:374] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.199666 9051 raft_consensus.cc:729] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.199940 9051 consensus_queue.cc:260] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.200601 9051 ts_tablet_manager.cc:1428] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 14:47:50.202639 9077 raft_consensus.cc:504] T 675413dc550f485dbef0d180ed27ff0e P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.205207 8662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "675413dc550f485dbef0d180ed27ff0e" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:47:50.205441 8662 raft_consensus.cc:3037] T 675413dc550f485dbef0d180ed27ff0e P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.207338 9058 raft_consensus.cc:482] T bd541e6a431348c7a506611681730fc5 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:50.207522 9058 raft_consensus.cc:504] T bd541e6a431348c7a506611681730fc5 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.208293 8662 raft_consensus.cc:2454] T 675413dc550f485dbef0d180ed27ff0e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:50.208853 9062 raft_consensus.cc:482] T 514af46a4b0c4c2f8e27b65a1322e976 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:50.209033 9062 raft_consensus.cc:504] T 514af46a4b0c4c2f8e27b65a1322e976 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.209405 9058 leader_election.cc:288] T bd541e6a431348c7a506611681730fc5 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:50.209589 9062 leader_election.cc:288] T 514af46a4b0c4c2f8e27b65a1322e976 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:50.209882 8869 leader_election.cc:302] T 675413dc550f485dbef0d180ed27ff0e P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:50.211848 9062 raft_consensus.cc:2781] T 675413dc550f485dbef0d180ed27ff0e P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election won for term 1
W20260620 14:47:50.212348 8871 leader_election.cc:341] T 514af46a4b0c4c2f8e27b65a1322e976 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 514af46a4b0c4c2f8e27b65a1322e976
I20260620 14:47:50.216025 8912 tablet_service.cc:1467] Processing CreateTablet for tablet 38195d2af2f243dc9f9f12a2ebb0d5eb (DEFAULT_TABLE table=default.table_7f82e63c368b415ca9ea3cd201986de1 [id=7f9c4b4af7614d20b0e5ddfbf7d2b0f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:50.216446 8912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38195d2af2f243dc9f9f12a2ebb0d5eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:50.221284 8641 tablet_service.cc:1467] Processing CreateTablet for tablet 38195d2af2f243dc9f9f12a2ebb0d5eb (DEFAULT_TABLE table=default.table_7f82e63c368b415ca9ea3cd201986de1 [id=7f9c4b4af7614d20b0e5ddfbf7d2b0f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:50.222215 8641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38195d2af2f243dc9f9f12a2ebb0d5eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:50.223263 8800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd541e6a431348c7a506611681730fc5" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:47:50.223519 8800 raft_consensus.cc:2454] T bd541e6a431348c7a506611681730fc5 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 0.
I20260620 14:47:50.224056 8598 leader_election.cc:302] T bd541e6a431348c7a506611681730fc5 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:50.224514 9058 raft_consensus.cc:2781] T bd541e6a431348c7a506611681730fc5 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:50.224648 9058 raft_consensus.cc:482] T bd541e6a431348c7a506611681730fc5 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:50.224771 9058 raft_consensus.cc:3037] T bd541e6a431348c7a506611681730fc5 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.227084 8780 tablet_service.cc:1467] Processing CreateTablet for tablet 38195d2af2f243dc9f9f12a2ebb0d5eb (DEFAULT_TABLE table=default.table_7f82e63c368b415ca9ea3cd201986de1 [id=7f9c4b4af7614d20b0e5ddfbf7d2b0f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:50.227559 8780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38195d2af2f243dc9f9f12a2ebb0d5eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:50.227463 9058 raft_consensus.cc:504] T bd541e6a431348c7a506611681730fc5 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.228135 9058 leader_election.cc:288] T bd541e6a431348c7a506611681730fc5 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 election: Requested vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:50.228709 8323 catalog_manager.cc:2148] created HMS catalog entry for table [id=a78802b888ed44b5b439381a6890a67d]
I20260620 14:47:50.229871 8800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd541e6a431348c7a506611681730fc5" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:47:50.230074 8800 raft_consensus.cc:3037] T bd541e6a431348c7a506611681730fc5 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.237289 8800 raft_consensus.cc:2454] T bd541e6a431348c7a506611681730fc5 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 1.
I20260620 14:47:50.239636 9062 raft_consensus.cc:686] T 675413dc550f485dbef0d180ed27ff0e P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Becoming Leader. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Running, Role: LEADER
I20260620 14:47:50.239988 9062 consensus_queue.cc:237] T 675413dc550f485dbef0d180ed27ff0e P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.242012 9069 raft_consensus.cc:482] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:50.243538 9069 raft_consensus.cc:504] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.244330 9069 leader_election.cc:288] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:47:50.245357 9051 tablet_bootstrap.cc:492] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:50.245553 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77f744b0f04a416099d955dcba1be34a" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4" is_pre_election: true
I20260620 14:47:50.245821 8935 raft_consensus.cc:2454] T 77f744b0f04a416099d955dcba1be34a P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 0.
I20260620 14:47:50.246743 8733 leader_election.cc:302] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4; no voters:
I20260620 14:47:50.247001 9051 tablet_bootstrap.cc:654] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:50.247102 9069 raft_consensus.cc:2781] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:50.247219 9069 raft_consensus.cc:482] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:50.247303 9069 raft_consensus.cc:3037] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.250087 9077 leader_election.cc:288] T 675413dc550f485dbef0d180ed27ff0e P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Requested vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:50.250167 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "675413dc550f485dbef0d180ed27ff0e" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:47:50.250481 8799 raft_consensus.cc:3037] T 675413dc550f485dbef0d180ed27ff0e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.252907 9069 raft_consensus.cc:504] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.254105 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77f744b0f04a416099d955dcba1be34a" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4"
I20260620 14:47:50.254323 8935 raft_consensus.cc:3037] T 77f744b0f04a416099d955dcba1be34a P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.257301 9048 tablet_bootstrap.cc:492] T 235446b4e9324eab836718837a0de8d5 P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:50.257778 9069 leader_election.cc:288] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 election: Requested vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:47:50.257944 8661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77f744b0f04a416099d955dcba1be34a" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:47:50.258213 8661 raft_consensus.cc:3037] T 77f744b0f04a416099d955dcba1be34a P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.258493 8799 raft_consensus.cc:2454] T 675413dc550f485dbef0d180ed27ff0e P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:50.259052 9048 tablet_bootstrap.cc:654] T 235446b4e9324eab836718837a0de8d5 P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:50.259495 8935 raft_consensus.cc:2454] T 77f744b0f04a416099d955dcba1be34a P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 1.
I20260620 14:47:50.259950 8733 leader_election.cc:302] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4; no voters:
I20260620 14:47:50.260324 8662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77f744b0f04a416099d955dcba1be34a" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:47:50.261389 8661 raft_consensus.cc:2454] T 77f744b0f04a416099d955dcba1be34a P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 1.
I20260620 14:47:50.261585 8914 tablet_service.cc:1514] Processing DeleteTablet for tablet b687f0fcc5bf46b49ea3705872c6af70 with delete_type TABLET_DATA_DELETED (replaced by tablet bd541e6a431348c7a506611681730fc5) from {username='slave'} at 127.0.0.1:56438
W20260620 14:47:50.262566 8316 catalog_manager.cc:4808] TS 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): delete failed for tablet b687f0fcc5bf46b49ea3705872c6af70 because the tablet was not found. No further retry: Not found: Tablet not found: b687f0fcc5bf46b49ea3705872c6af70
I20260620 14:47:50.263032 8326 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59860:
name: "default.Table_1ea7c21a49a443c29bd5578c5950c27f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:50.265134 9051 tablet_bootstrap.cc:492] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:50.265296 9051 ts_tablet_manager.cc:1397] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.020s user 0.010s sys 0.001s
I20260620 14:47:50.265703 9069 raft_consensus.cc:2781] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:50.266055 9051 raft_consensus.cc:348] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.266211 8598 leader_election.cc:302] T bd541e6a431348c7a506611681730fc5 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:50.266300 9051 raft_consensus.cc:374] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.266364 9051 raft_consensus.cc:729] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.266597 9051 consensus_queue.cc:260] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.267220 9051 ts_tablet_manager.cc:1428] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 14:47:50.271621 8323 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:59860 (request call id 9) took 1213 ms. Trace:
I20260620 14:47:50.271976 9069 raft_consensus.cc:686] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c [term 1 LEADER]: Becoming Leader. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Running, Role: LEADER
I20260620 14:47:50.271765 8323 rpcz_store.cc:276] 0620 14:47:49.058526 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:49.058649 (+ 123us) service_pool.cc:227] Handling call
0620 14:47:49.493219 (+434570us) catalog_manager.cc:2075] Acquired catalog manager lock
0620 14:47:49.496263 (+ 3044us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x6060000a8778. stack: 00007f929b55e66e 00007f929b55e430 00007f929a5e55ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f929b47fdcf 00007f929b47fb00 00007f92ae39f853 00007f92ae399c3f 00007f92ae392d35 00007f92ae59446a 00007f92a5886466 00007f92a5886195 00007f92a209a9be 00007f92a209979e
0620 14:47:49.496478 (+ 215us) catalog_manager.cc:2121] Created new table and tablet info
0620 14:47:50.228660 (+732182us) catalog_manager.cc:2147] Created new table in HMS catalog
0620 14:47:50.271357 (+ 42697us) catalog_manager.cc:2181] Wrote table and tablets to system table
0620 14:47:50.271479 (+ 122us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0620 14:47:50.271581 (+ 102us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 14:47:50.232944 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 14:47:50.233073 (+ 129us) write_op.cc:432] Acquiring schema lock in shared mode
0620 14:47:50.233080 (+ 7us) write_op.cc:435] Acquired schema lock
0620 14:47:50.233082 (+ 2us) tablet.cc:660] Decoding operations
0620 14:47:50.233197 (+ 115us) write_op.cc:620] Acquiring the partition lock for write op
0620 14:47:50.233218 (+ 21us) write_op.cc:641] Partition lock acquired for write op
0620 14:47:50.233225 (+ 7us) tablet.cc:683] Acquiring locks for 2 operations
0620 14:47:50.233339 (+ 114us) tablet.cc:699] Row locks acquired
0620 14:47:50.233342 (+ 3us) write_op.cc:260] PREPARE: finished
0620 14:47:50.233411 (+ 69us) write_op.cc:270] Start()
0620 14:47:50.233463 (+ 52us) write_op.cc:276] Timestamp: P: 1781966870233356 usec, L: 0
0620 14:47:50.233467 (+ 4us) op_driver.cc:331] REPLICATION: starting
0620 14:47:50.233702 (+ 235us) log.cc:842] Serialized 432 byte log entry
0620 14:47:50.270540 (+ 36838us) op_driver.cc:444] REPLICATION: finished
0620 14:47:50.270685 (+ 145us) write_op.cc:301] APPLY: starting
0620 14:47:50.270705 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
0620 14:47:50.270758 (+ 53us) tablet.cc:1368] finished BulkCheckPresence
0620 14:47:50.270791 (+ 33us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 14:47:50.270925 (+ 134us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 14:47:50.270966 (+ 41us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0620 14:47:50.270977 (+ 11us) write_op.cc:312] APPLY: finished
0620 14:47:50.271072 (+ 95us) log.cc:842] Serialized 28 byte log entry
0620 14:47:50.271144 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0620 14:47:50.271170 (+ 26us) write_op.cc:454] Released schema lock
0620 14:47:50.271178 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0620 14:47:50.271239 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0620 14:47:50.271243 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":676385,"Hive Metastore.run_cpu_time_us":273,"Hive Metastore.run_wall_time_us":55407,"spinlock_wait_cycles":5296512,"child_traces":[["op",{"apply.queue_time_us":94,"apply.run_cpu_time_us":610,"apply.run_wall_time_us":610,"num_ops":2,"prepare.queue_time_us":3463,"prepare.run_cpu_time_us":899,"prepare.run_wall_time_us":2663,"raft.queue_time_us":1714,"raft.run_cpu_time_us":11,"raft.run_wall_time_us":11,"replication_time_us":37047}]]}
I20260620 14:47:50.272432 9069 consensus_queue.cc:237] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.273474 8323 catalog_manager.cc:5495] T 675413dc550f485dbef0d180ed27ff0e P 6c99207e35f8463292d71c371c9546b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c99207e35f8463292d71c371c9546b4 (127.7.222.195). New cstate: current_term: 1 leader_uuid: "6c99207e35f8463292d71c371c9546b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } health_report { overall_health: UNKNOWN } } }
I20260620 14:47:50.278388 9058 raft_consensus.cc:2781] T bd541e6a431348c7a506611681730fc5 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:50.285080 8323 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59860:
name: "default.Table_98318448fcf3484cb76812dad2975098"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:50.285930 8329 catalog_manager.cc:2148] created HMS catalog entry for table [id=3420fc1c9c8b45f49aeaa7b4c97da51e]
I20260620 14:47:50.289503 9049 tablet_bootstrap.cc:492] T 235446b4e9324eab836718837a0de8d5 P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:50.289666 9049 ts_tablet_manager.cc:1397] T 235446b4e9324eab836718837a0de8d5 P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.106s user 0.000s sys 0.016s
I20260620 14:47:50.291525 9049 raft_consensus.cc:348] T 235446b4e9324eab836718837a0de8d5 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.291790 9049 raft_consensus.cc:374] T 235446b4e9324eab836718837a0de8d5 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.291913 9049 raft_consensus.cc:729] T 235446b4e9324eab836718837a0de8d5 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.292264 8914 tablet_service.cc:1514] Processing DeleteTablet for tablet 514af46a4b0c4c2f8e27b65a1322e976 with delete_type TABLET_DATA_DELETED (replaced by tablet bdd71e7f271c40d4b722f38d32b1ea1d) from {username='slave'} at 127.0.0.1:56438
I20260620 14:47:50.292188 9049 consensus_queue.cc:260] T 235446b4e9324eab836718837a0de8d5 P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.295502 9056 tablet_replica.cc:330] T 514af46a4b0c4c2f8e27b65a1322e976 P 6c99207e35f8463292d71c371c9546b4: stopping tablet replica
I20260620 14:47:50.295729 9056 raft_consensus.cc:2229] T 514af46a4b0c4c2f8e27b65a1322e976 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:50.295900 9056 raft_consensus.cc:2258] T 514af46a4b0c4c2f8e27b65a1322e976 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:50.296689 9056 ts_tablet_manager.cc:1905] T 514af46a4b0c4c2f8e27b65a1322e976 P 6c99207e35f8463292d71c371c9546b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:50.300024 9049 ts_tablet_manager.cc:1428] T 235446b4e9324eab836718837a0de8d5 P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.010s user 0.002s sys 0.002s
I20260620 14:47:50.300297 9049 tablet_bootstrap.cc:492] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:50.302027 9049 tablet_bootstrap.cc:654] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:50.310156 9056 ts_tablet_manager.cc:1918] T 514af46a4b0c4c2f8e27b65a1322e976 P 6c99207e35f8463292d71c371c9546b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 14:47:50.310328 9056 log.cc:1196] T 514af46a4b0c4c2f8e27b65a1322e976 P 6c99207e35f8463292d71c371c9546b4: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal/wals/514af46a4b0c4c2f8e27b65a1322e976
I20260620 14:47:50.310719 9056 ts_tablet_manager.cc:1939] T 514af46a4b0c4c2f8e27b65a1322e976 P 6c99207e35f8463292d71c371c9546b4: Deleting consensus metadata
I20260620 14:47:50.311894 8329 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:59860 (request call id 3) took 1257 ms. Trace:
W20260620 14:47:50.312597 8869 leader_election.cc:341] T 514af46a4b0c4c2f8e27b65a1322e976 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821): Not found: Tablet not found: 514af46a4b0c4c2f8e27b65a1322e976
I20260620 14:47:50.312039 8329 rpcz_store.cc:276] 0620 14:47:49.054592 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:49.055780 (+ 1188us) service_pool.cc:227] Handling call
0620 14:47:49.494771 (+438991us) catalog_manager.cc:2075] Acquired catalog manager lock
0620 14:47:49.496825 (+ 2054us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x6060000a8778. stack: 00007f929b55e66e 00007f929b55e430 00007f929a5e55ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f929b47fdcf 00007f929b47fb00 00007f92ae39f853 00007f92ae399c3f 00007f92ae392d35 00007f92ae59446a 00007f92a5886466 00007f92a5886195 00007f92a209a9be 00007f92a209979e
0620 14:47:49.497033 (+ 208us) catalog_manager.cc:2121] Created new table and tablet info
0620 14:47:50.285857 (+788824us) catalog_manager.cc:2147] Created new table in HMS catalog
0620 14:47:50.311643 (+ 25786us) catalog_manager.cc:2181] Wrote table and tablets to system table
0620 14:47:50.311745 (+ 102us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0620 14:47:50.311836 (+ 91us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 14:47:50.286596 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 14:47:50.286685 (+ 89us) write_op.cc:432] Acquiring schema lock in shared mode
0620 14:47:50.286690 (+ 5us) write_op.cc:435] Acquired schema lock
0620 14:47:50.286694 (+ 4us) tablet.cc:660] Decoding operations
0620 14:47:50.286778 (+ 84us) write_op.cc:620] Acquiring the partition lock for write op
0620 14:47:50.286787 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0620 14:47:50.286792 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0620 14:47:50.286856 (+ 64us) tablet.cc:699] Row locks acquired
0620 14:47:50.286858 (+ 2us) write_op.cc:260] PREPARE: finished
0620 14:47:50.286901 (+ 43us) write_op.cc:270] Start()
0620 14:47:50.286926 (+ 25us) write_op.cc:276] Timestamp: P: 1781966870286847 usec, L: 0
0620 14:47:50.286929 (+ 3us) op_driver.cc:331] REPLICATION: starting
0620 14:47:50.287064 (+ 135us) log.cc:842] Serialized 432 byte log entry
0620 14:47:50.308223 (+ 21159us) op_driver.cc:444] REPLICATION: finished
0620 14:47:50.309692 (+ 1469us) write_op.cc:301] APPLY: starting
0620 14:47:50.309702 (+ 10us) tablet.cc:1365] starting BulkCheckPresence
0620 14:47:50.309732 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
0620 14:47:50.309762 (+ 30us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 14:47:50.309895 (+ 133us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 14:47:50.309930 (+ 35us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0620 14:47:50.309936 (+ 6us) write_op.cc:312] APPLY: finished
0620 14:47:50.310001 (+ 65us) log.cc:842] Serialized 28 byte log entry
0620 14:47:50.310045 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0620 14:47:50.310059 (+ 14us) write_op.cc:454] Released schema lock
0620 14:47:50.310064 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0620 14:47:50.310115 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0620 14:47:50.310118 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":731210,"Hive Metastore.run_cpu_time_us":258,"Hive Metastore.run_wall_time_us":57251,"spinlock_wait_cycles":3415552,"child_traces":[["op",{"apply.queue_time_us":1434,"apply.run_cpu_time_us":466,"apply.run_wall_time_us":464,"num_ops":2,"prepare.queue_time_us":137,"prepare.run_cpu_time_us":546,"prepare.run_wall_time_us":1093,"raft.queue_time_us":540,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":3,"replication_time_us":21275}]]}
I20260620 14:47:50.312727 8869 leader_election.cc:302] T 514af46a4b0c4c2f8e27b65a1322e976 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4; no voters: 36236dd5bd604ba2819038e525a3790c, c0e6c57ab91e42bf9be3739c816916c0
W20260620 14:47:50.312959 8869 raft_consensus.cc:2670] T 514af46a4b0c4c2f8e27b65a1322e976 P 6c99207e35f8463292d71c371c9546b4: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260620 14:47:50.314020 8329 master_service.cc:946] ReplaceTablet: received request to replace tablet 514af46a4b0c4c2f8e27b65a1322e976 from {username='slave'} at 127.0.0.1:59860
I20260620 14:47:50.314682 8329 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59860:
table { table_name: "default.Table_a800f01d336648a8b400cefc457c444d" } modify_external_catalogs: true
I20260620 14:47:50.314687 8934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd541e6a431348c7a506611681730fc5" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4"
I20260620 14:47:50.314929 8934 raft_consensus.cc:3037] T bd541e6a431348c7a506611681730fc5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.314930 8329 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59860:
table { table_name: "default.Table_a800f01d336648a8b400cefc457c444d" } modify_external_catalogs: true
I20260620 14:47:50.317832 8934 raft_consensus.cc:2454] T bd541e6a431348c7a506611681730fc5 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 1.
I20260620 14:47:50.318300 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd541e6a431348c7a506611681730fc5" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4" is_pre_election: true
I20260620 14:47:50.318536 8935 raft_consensus.cc:2362] T bd541e6a431348c7a506611681730fc5 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 1. Re-sending same reply.
I20260620 14:47:50.319110 8780 tablet_service.cc:1467] Processing CreateTablet for tablet 3a85749745a7440fb637d4918de5f798 (DEFAULT_TABLE table=default.table_de1c78a84d1349dea4d9e9d032a258be [id=a78802b888ed44b5b439381a6890a67d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:50.319600 8780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a85749745a7440fb637d4918de5f798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:50.320158 9058 raft_consensus.cc:686] T bd541e6a431348c7a506611681730fc5 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 LEADER]: Becoming Leader. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Running, Role: LEADER
I20260620 14:47:50.320569 9058 consensus_queue.cc:237] T bd541e6a431348c7a506611681730fc5 P c0e6c57ab91e42bf9be3739c816916c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.325572 8316 catalog_manager.cc:4841] TS 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): tablet 514af46a4b0c4c2f8e27b65a1322e976 (table default.table_0210e4215f5f4663af08e8f4da05f3b3 [id=9c1e21a6c9244efba2e86bfa28264a0d]) successfully deleted
I20260620 14:47:50.326546 8641 tablet_service.cc:1467] Processing CreateTablet for tablet 3a85749745a7440fb637d4918de5f798 (DEFAULT_TABLE table=default.table_de1c78a84d1349dea4d9e9d032a258be [id=a78802b888ed44b5b439381a6890a67d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:50.327011 8641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a85749745a7440fb637d4918de5f798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:50.330891 8914 tablet_service.cc:1467] Processing CreateTablet for tablet 3a85749745a7440fb637d4918de5f798 (DEFAULT_TABLE table=default.table_de1c78a84d1349dea4d9e9d032a258be [id=a78802b888ed44b5b439381a6890a67d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:50.331303 8914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a85749745a7440fb637d4918de5f798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:50.342082 9048 tablet_bootstrap.cc:492] T 235446b4e9324eab836718837a0de8d5 P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:50.342211 9051 tablet_bootstrap.cc:492] T 3a85749745a7440fb637d4918de5f798 P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:50.342242 9048 ts_tablet_manager.cc:1397] T 235446b4e9324eab836718837a0de8d5 P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.085s user 0.006s sys 0.010s
I20260620 14:47:50.343931 9051 tablet_bootstrap.cc:654] T 3a85749745a7440fb637d4918de5f798 P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:50.342995 9048 raft_consensus.cc:348] T 235446b4e9324eab836718837a0de8d5 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.344077 9048 raft_consensus.cc:374] T 235446b4e9324eab836718837a0de8d5 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.344205 9048 raft_consensus.cc:729] T 235446b4e9324eab836718837a0de8d5 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.344480 9048 consensus_queue.cc:260] T 235446b4e9324eab836718837a0de8d5 P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.345115 9048 ts_tablet_manager.cc:1428] T 235446b4e9324eab836718837a0de8d5 P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 14:47:50.348456 9049 tablet_bootstrap.cc:492] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:50.348656 9049 ts_tablet_manager.cc:1397] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.048s user 0.003s sys 0.000s
I20260620 14:47:50.351435 9051 tablet_bootstrap.cc:492] T 3a85749745a7440fb637d4918de5f798 P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:50.351576 9051 ts_tablet_manager.cc:1397] T 3a85749745a7440fb637d4918de5f798 P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.004s
I20260620 14:47:50.352347 9051 raft_consensus.cc:348] T 3a85749745a7440fb637d4918de5f798 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.352597 9051 raft_consensus.cc:374] T 3a85749745a7440fb637d4918de5f798 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.352689 9051 raft_consensus.cc:729] T 3a85749745a7440fb637d4918de5f798 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.353083 9048 tablet_bootstrap.cc:492] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:50.352967 9051 consensus_queue.cc:260] T 3a85749745a7440fb637d4918de5f798 P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.354555 9051 ts_tablet_manager.cc:1428] T 3a85749745a7440fb637d4918de5f798 P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260620 14:47:50.355372 9048 tablet_bootstrap.cc:654] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:50.359119 8641 tablet_service.cc:1467] Processing CreateTablet for tablet c33a5b17df824c0ab066dee1fa610906 (DEFAULT_TABLE table=default.table_0eb776233cee4294b6c96ec556447663 [id=3420fc1c9c8b45f49aeaa7b4c97da51e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:50.359549 8641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c33a5b17df824c0ab066dee1fa610906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:50.349632 9049 raft_consensus.cc:348] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.361323 9049 raft_consensus.cc:374] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.361258 8780 tablet_service.cc:1467] Processing CreateTablet for tablet c33a5b17df824c0ab066dee1fa610906 (DEFAULT_TABLE table=default.table_0eb776233cee4294b6c96ec556447663 [id=3420fc1c9c8b45f49aeaa7b4c97da51e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:50.361420 9049 raft_consensus.cc:729] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.361662 8780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c33a5b17df824c0ab066dee1fa610906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:50.361698 9049 consensus_queue.cc:260] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.361860 8914 tablet_service.cc:1467] Processing CreateTablet for tablet c33a5b17df824c0ab066dee1fa610906 (DEFAULT_TABLE table=default.table_0eb776233cee4294b6c96ec556447663 [id=3420fc1c9c8b45f49aeaa7b4c97da51e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:50.362224 8914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c33a5b17df824c0ab066dee1fa610906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:50.362290 9049 ts_tablet_manager.cc:1428] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260620 14:47:50.362597 9049 tablet_bootstrap.cc:492] T 3a85749745a7440fb637d4918de5f798 P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:50.364125 9049 tablet_bootstrap.cc:654] T 3a85749745a7440fb637d4918de5f798 P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:50.369104 9051 tablet_bootstrap.cc:492] T c33a5b17df824c0ab066dee1fa610906 P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:50.370836 9051 tablet_bootstrap.cc:654] T c33a5b17df824c0ab066dee1fa610906 P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:50.372491 9048 tablet_bootstrap.cc:492] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:50.372695 9048 ts_tablet_manager.cc:1397] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.002s
I20260620 14:47:50.373780 9048 raft_consensus.cc:348] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.374109 9048 raft_consensus.cc:374] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.374197 9048 raft_consensus.cc:729] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.374557 9048 consensus_queue.cc:260] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.375296 9048 ts_tablet_manager.cc:1428] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 14:47:50.376962 9048 tablet_bootstrap.cc:492] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:50.379235 9048 tablet_bootstrap.cc:654] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:50.386000 9051 tablet_bootstrap.cc:492] T c33a5b17df824c0ab066dee1fa610906 P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:50.386188 9051 ts_tablet_manager.cc:1397] T c33a5b17df824c0ab066dee1fa610906 P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.012s
I20260620 14:47:50.386945 9051 raft_consensus.cc:348] T c33a5b17df824c0ab066dee1fa610906 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.387200 9051 raft_consensus.cc:374] T c33a5b17df824c0ab066dee1fa610906 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.387277 9051 raft_consensus.cc:729] T c33a5b17df824c0ab066dee1fa610906 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.387554 9051 consensus_queue.cc:260] T c33a5b17df824c0ab066dee1fa610906 P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.389281 9051 ts_tablet_manager.cc:1428] T c33a5b17df824c0ab066dee1fa610906 P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260620 14:47:50.395483 9048 tablet_bootstrap.cc:492] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:50.395643 9048 ts_tablet_manager.cc:1397] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.001s
I20260620 14:47:50.396405 9048 raft_consensus.cc:348] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.396700 9048 raft_consensus.cc:374] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.396823 9048 raft_consensus.cc:729] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.397053 9048 consensus_queue.cc:260] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.397979 9048 ts_tablet_manager.cc:1428] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260620 14:47:50.398295 9048 tablet_bootstrap.cc:492] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:50.399039 9049 tablet_bootstrap.cc:492] T 3a85749745a7440fb637d4918de5f798 P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:50.399200 9049 ts_tablet_manager.cc:1397] T 3a85749745a7440fb637d4918de5f798 P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.037s user 0.005s sys 0.005s
I20260620 14:47:50.400295 9049 raft_consensus.cc:348] T 3a85749745a7440fb637d4918de5f798 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.400558 9049 raft_consensus.cc:374] T 3a85749745a7440fb637d4918de5f798 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.400660 9049 raft_consensus.cc:729] T 3a85749745a7440fb637d4918de5f798 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.400945 9049 consensus_queue.cc:260] T 3a85749745a7440fb637d4918de5f798 P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.403395 9049 ts_tablet_manager.cc:1428] T 3a85749745a7440fb637d4918de5f798 P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260620 14:47:50.404466 9049 tablet_bootstrap.cc:492] T c33a5b17df824c0ab066dee1fa610906 P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:50.406059 9049 tablet_bootstrap.cc:654] T c33a5b17df824c0ab066dee1fa610906 P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:50.408330 9069 raft_consensus.cc:482] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:50.408542 9048 tablet_bootstrap.cc:654] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:50.408566 9069 raft_consensus.cc:504] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.409425 9069 leader_election.cc:288] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:47:50.410408 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdd71e7f271c40d4b722f38d32b1ea1d" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4" is_pre_election: true
I20260620 14:47:50.410730 8935 raft_consensus.cc:2454] T bdd71e7f271c40d4b722f38d32b1ea1d P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 0.
I20260620 14:47:50.411335 8733 leader_election.cc:302] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4; no voters:
I20260620 14:47:50.412127 8661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdd71e7f271c40d4b722f38d32b1ea1d" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:47:50.412402 8661 raft_consensus.cc:2454] T bdd71e7f271c40d4b722f38d32b1ea1d P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 0.
I20260620 14:47:50.413120 9069 raft_consensus.cc:2781] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:50.413216 9069 raft_consensus.cc:482] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:50.413322 9069 raft_consensus.cc:3037] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.414742 9048 tablet_bootstrap.cc:492] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:50.414897 9048 ts_tablet_manager.cc:1397] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.004s
I20260620 14:47:50.415623 9048 raft_consensus.cc:348] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.415896 9048 raft_consensus.cc:374] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.415985 9048 raft_consensus.cc:729] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.416064 9069 raft_consensus.cc:504] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.417131 8661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdd71e7f271c40d4b722f38d32b1ea1d" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:47:50.417380 8661 raft_consensus.cc:3037] T bdd71e7f271c40d4b722f38d32b1ea1d P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.417539 9048 consensus_queue.cc:260] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.418125 9048 ts_tablet_manager.cc:1428] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260620 14:47:50.420228 9049 tablet_bootstrap.cc:492] T c33a5b17df824c0ab066dee1fa610906 P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:50.420460 9049 ts_tablet_manager.cc:1397] T c33a5b17df824c0ab066dee1fa610906 P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.005s
I20260620 14:47:50.420686 8661 raft_consensus.cc:2454] T bdd71e7f271c40d4b722f38d32b1ea1d P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 1.
I20260620 14:47:50.421161 8733 leader_election.cc:302] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:50.421489 9054 raft_consensus.cc:2781] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:50.421391 9049 raft_consensus.cc:348] T c33a5b17df824c0ab066dee1fa610906 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.421608 9049 raft_consensus.cc:374] T c33a5b17df824c0ab066dee1fa610906 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.421703 9049 raft_consensus.cc:729] T c33a5b17df824c0ab066dee1fa610906 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.421928 9049 consensus_queue.cc:260] T c33a5b17df824c0ab066dee1fa610906 P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.422454 9049 ts_tablet_manager.cc:1428] T c33a5b17df824c0ab066dee1fa610906 P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 14:47:50.423813 9069 leader_election.cc:288] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 election: Requested vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:47:50.424341 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdd71e7f271c40d4b722f38d32b1ea1d" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4"
I20260620 14:47:50.424551 8935 raft_consensus.cc:3037] T bdd71e7f271c40d4b722f38d32b1ea1d P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.432945 9069 raft_consensus.cc:482] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:50.433162 9069 raft_consensus.cc:504] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.433871 9069 leader_election.cc:288] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:47:50.434592 8934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ad679f398ab41a1bc207b016648cbe8" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4" is_pre_election: true
I20260620 14:47:50.434895 8934 raft_consensus.cc:2454] T 1ad679f398ab41a1bc207b016648cbe8 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 0.
I20260620 14:47:50.434983 8935 raft_consensus.cc:2454] T bdd71e7f271c40d4b722f38d32b1ea1d P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 1.
I20260620 14:47:50.435513 8733 leader_election.cc:302] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4; no voters:
I20260620 14:47:50.436076 9069 raft_consensus.cc:2781] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:50.436172 9069 raft_consensus.cc:482] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:50.436269 9069 raft_consensus.cc:3037] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.439718 8661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ad679f398ab41a1bc207b016648cbe8" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:47:50.439939 9069 raft_consensus.cc:504] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.441255 8662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ad679f398ab41a1bc207b016648cbe8" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:47:50.441486 8662 raft_consensus.cc:3037] T 1ad679f398ab41a1bc207b016648cbe8 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.444737 8662 raft_consensus.cc:2454] T 1ad679f398ab41a1bc207b016648cbe8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 1.
I20260620 14:47:50.445363 8733 leader_election.cc:302] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:50.445739 8661 raft_consensus.cc:2362] T 1ad679f398ab41a1bc207b016648cbe8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 1. Re-sending same reply.
I20260620 14:47:50.446434 9069 leader_election.cc:288] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 election: Requested vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:47:50.447137 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ad679f398ab41a1bc207b016648cbe8" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4"
I20260620 14:47:50.447448 8935 raft_consensus.cc:3037] T 1ad679f398ab41a1bc207b016648cbe8 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.448911 9069 raft_consensus.cc:2781] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:50.449128 9069 raft_consensus.cc:686] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c [term 1 LEADER]: Becoming Leader. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Running, Role: LEADER
I20260620 14:47:50.449522 9069 consensus_queue.cc:237] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.452330 8935 raft_consensus.cc:2454] T 1ad679f398ab41a1bc207b016648cbe8 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 1.
I20260620 14:47:50.465209 9054 raft_consensus.cc:686] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c [term 1 LEADER]: Becoming Leader. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Running, Role: LEADER
I20260620 14:47:50.465644 9054 consensus_queue.cc:237] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.575546 9054 raft_consensus.cc:482] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:50.575783 9054 raft_consensus.cc:504] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.576469 9054 leader_election.cc:288] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:47:50.577699 8661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a85749745a7440fb637d4918de5f798" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:47:50.577960 8661 raft_consensus.cc:2454] T 3a85749745a7440fb637d4918de5f798 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 0.
I20260620 14:47:50.578356 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a85749745a7440fb637d4918de5f798" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4" is_pre_election: true
I20260620 14:47:50.578577 8935 raft_consensus.cc:2454] T 3a85749745a7440fb637d4918de5f798 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 0.
I20260620 14:47:50.579320 8733 leader_election.cc:302] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:50.579875 9054 raft_consensus.cc:2781] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:50.579960 9054 raft_consensus.cc:482] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:50.580042 9054 raft_consensus.cc:3037] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.582727 9054 raft_consensus.cc:504] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.583921 8661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a85749745a7440fb637d4918de5f798" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
W20260620 14:47:50.583772 9083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
I20260620 14:47:50.584115 8661 raft_consensus.cc:3037] T 3a85749745a7440fb637d4918de5f798 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
W20260620 14:47:50.584183 9083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:47:50.584295 9083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260620 14:47:50.586871 8661 raft_consensus.cc:2454] T 3a85749745a7440fb637d4918de5f798 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 1.
I20260620 14:47:50.587662 8733 leader_election.cc:302] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:50.587960 9115 raft_consensus.cc:2781] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:50.588083 9115 raft_consensus.cc:686] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c [term 1 LEADER]: Becoming Leader. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Running, Role: LEADER
I20260620 14:47:50.588366 9115 consensus_queue.cc:237] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.591929 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a85749745a7440fb637d4918de5f798" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4"
I20260620 14:47:50.592144 8935 raft_consensus.cc:3037] T 3a85749745a7440fb637d4918de5f798 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.593382 9062 raft_consensus.cc:482] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:50.593578 9062 raft_consensus.cc:504] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.593690 9054 leader_election.cc:288] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 election: Requested vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:47:50.594184 9062 leader_election.cc:288] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:50.595134 8800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "235446b4e9324eab836718837a0de8d5" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:47:50.595455 8800 raft_consensus.cc:2454] T 235446b4e9324eab836718837a0de8d5 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:50.595654 8935 raft_consensus.cc:2454] T 3a85749745a7440fb637d4918de5f798 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 1.
I20260620 14:47:50.596086 8871 leader_election.cc:302] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4; no voters:
I20260620 14:47:50.596444 9062 raft_consensus.cc:2781] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:50.596459 8661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "235446b4e9324eab836718837a0de8d5" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:47:50.597028 8661 raft_consensus.cc:2454] T 235446b4e9324eab836718837a0de8d5 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:50.597003 9062 raft_consensus.cc:482] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:50.597368 9062 raft_consensus.cc:3037] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
W20260620 14:47:50.597544 9083 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:47:50.597649 9083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:47:50.597709 9083 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:47:50.597775 9083 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:47:50.600992 9062 raft_consensus.cc:504] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.602108 8661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "235446b4e9324eab836718837a0de8d5" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:47:50.602356 8661 raft_consensus.cc:3037] T 235446b4e9324eab836718837a0de8d5 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.602918 9062 leader_election.cc:288] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Requested vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:50.603577 8800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "235446b4e9324eab836718837a0de8d5" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:47:50.603842 8800 raft_consensus.cc:3037] T 235446b4e9324eab836718837a0de8d5 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.606237 8800 raft_consensus.cc:2454] T 235446b4e9324eab836718837a0de8d5 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:50.606804 8871 leader_election.cc:302] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4; no voters:
I20260620 14:47:50.607250 9062 raft_consensus.cc:2781] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:50.607419 9062 raft_consensus.cc:686] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Becoming Leader. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Running, Role: LEADER
I20260620 14:47:50.607671 9062 consensus_queue.cc:237] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.611662 8661 raft_consensus.cc:2454] T 235446b4e9324eab836718837a0de8d5 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:50.612457 9083 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.222.212:42755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:42797
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.222.253:34209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.222.253
--webserver_port=40901
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 13:41:20 UTC on ccycloud.quasar-vdagoi.root.comops.site
build id 4457462
ASAN enabled
I20260620 14:47:50.614693 9083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:47:50.617117 9083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:47:50.635574 9124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:47:50.639592 9125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:47:50.648609 9058 raft_consensus.cc:482] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:50.648908 9058 raft_consensus.cc:504] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.649840 9058 leader_election.cc:288] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:50.651399 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38195d2af2f243dc9f9f12a2ebb0d5eb" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4" is_pre_election: true
I20260620 14:47:50.651757 8935 raft_consensus.cc:2454] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 0.
I20260620 14:47:50.652251 8800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38195d2af2f243dc9f9f12a2ebb0d5eb" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:47:50.652523 8800 raft_consensus.cc:2454] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 0.
I20260620 14:47:50.653076 8596 leader_election.cc:302] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:50.653999 9058 raft_consensus.cc:2781] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:50.654124 9058 raft_consensus.cc:482] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:50.654245 9058 raft_consensus.cc:3037] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.657922 9058 raft_consensus.cc:504] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.659307 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38195d2af2f243dc9f9f12a2ebb0d5eb" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4"
I20260620 14:47:50.659552 8935 raft_consensus.cc:3037] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.659801 8800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38195d2af2f243dc9f9f12a2ebb0d5eb" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:47:50.659991 8800 raft_consensus.cc:3037] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.660965 9058 leader_election.cc:288] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 election: Requested vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:50.661527 9083 server_base.cc:1034] running on GCE node
I20260620 14:47:50.662467 8935 raft_consensus.cc:2454] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 1.
I20260620 14:47:50.662890 8596 leader_election.cc:302] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:50.662946 8800 raft_consensus.cc:2454] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 1.
I20260620 14:47:50.663247 9058 raft_consensus.cc:2781] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:50.663427 9058 raft_consensus.cc:686] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0 [term 1 LEADER]: Becoming Leader. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Running, Role: LEADER
I20260620 14:47:50.663671 9058 consensus_queue.cc:237] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:50.664306 9115 raft_consensus.cc:482] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:50.664474 9115 raft_consensus.cc:504] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.665138 9115 leader_election.cc:288] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:47:50.665937 8661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c33a5b17df824c0ab066dee1fa610906" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:47:50.666221 8661 raft_consensus.cc:2454] T c33a5b17df824c0ab066dee1fa610906 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 0.
I20260620 14:47:50.667029 8733 leader_election.cc:302] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:50.667469 9115 raft_consensus.cc:2781] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:50.667606 9115 raft_consensus.cc:482] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:50.667868 9115 raft_consensus.cc:3037] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.671456 9115 raft_consensus.cc:504] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.671957 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c33a5b17df824c0ab066dee1fa610906" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4" is_pre_election: true
I20260620 14:47:50.672772 9115 leader_election.cc:288] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 election: Requested vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:47:50.673192 9127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:47:50.674479 9083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:47:50.675244 8661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c33a5b17df824c0ab066dee1fa610906" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:47:50.675447 8661 raft_consensus.cc:3037] T c33a5b17df824c0ab066dee1fa610906 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.678853 8661 raft_consensus.cc:2454] T c33a5b17df824c0ab066dee1fa610906 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 1.
I20260620 14:47:50.679565 8733 leader_election.cc:302] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:50.674741 8934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c33a5b17df824c0ab066dee1fa610906" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4"
I20260620 14:47:50.680305 8934 raft_consensus.cc:3037] T c33a5b17df824c0ab066dee1fa610906 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.684130 8934 raft_consensus.cc:2454] T c33a5b17df824c0ab066dee1fa610906 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 1.
I20260620 14:47:50.685026 9083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:47:50.685649 9115 raft_consensus.cc:2781] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:50.685644 8935 raft_consensus.cc:2362] T c33a5b17df824c0ab066dee1fa610906 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 1. Re-sending same reply.
I20260620 14:47:50.685986 9115 raft_consensus.cc:686] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c [term 1 LEADER]: Becoming Leader. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Running, Role: LEADER
I20260620 14:47:50.686303 9115 consensus_queue.cc:237] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.693034 9083 hybrid_clock.cc:648] HybridClock initialized: now 1781966870692826 us; error 181 us; skew 500 ppm
I20260620 14:47:50.693646 9083 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 14:47:50.699082 9083 webserver.cc:460] Webserver started at http://127.7.222.253:40901/ using document root <none> and password file <none>
I20260620 14:47:50.699934 9083 fs_manager.cc:359] Metadata directory not provided
I20260620 14:47:50.700086 9083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:47:50.703299 9058 raft_consensus.cc:482] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:50.703485 9058 raft_consensus.cc:504] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.704216 9058 leader_election.cc:288] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:47:50.705052 8800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79da710506b745fb8e807b52a9dc54ab" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:47:50.705308 8800 raft_consensus.cc:2454] T 79da710506b745fb8e807b52a9dc54ab P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 0.
I20260620 14:47:50.705446 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79da710506b745fb8e807b52a9dc54ab" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4" is_pre_election: true
I20260620 14:47:50.705681 8935 raft_consensus.cc:2454] T 79da710506b745fb8e807b52a9dc54ab P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 0.
I20260620 14:47:50.705770 8598 leader_election.cc:302] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:50.706187 9058 raft_consensus.cc:2781] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:50.706333 9058 raft_consensus.cc:482] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:50.706461 9058 raft_consensus.cc:3037] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.710208 9058 raft_consensus.cc:504] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.711508 8800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79da710506b745fb8e807b52a9dc54ab" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:47:50.711802 8800 raft_consensus.cc:3037] T 79da710506b745fb8e807b52a9dc54ab P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.715579 8800 raft_consensus.cc:2454] T 79da710506b745fb8e807b52a9dc54ab P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 1.
I20260620 14:47:50.716120 8598 leader_election.cc:302] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:50.716506 9102 raft_consensus.cc:2781] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:50.716717 9102 raft_consensus.cc:686] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0 [term 1 LEADER]: Becoming Leader. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Running, Role: LEADER
I20260620 14:47:50.717378 9058 leader_election.cc:288] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 election: Requested vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:47:50.718011 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79da710506b745fb8e807b52a9dc54ab" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4"
I20260620 14:47:50.718246 8935 raft_consensus.cc:3037] T 79da710506b745fb8e807b52a9dc54ab P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:50.720392 9083 fs_manager.cc:709] Time spent opening directory manager: real 0.018s user 0.007s sys 0.008s
I20260620 14:47:50.720983 8935 raft_consensus.cc:2454] T 79da710506b745fb8e807b52a9dc54ab P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 1.
I20260620 14:47:50.717233 9102 consensus_queue.cc:237] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.730734 9136 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:47:50.732260 8331 catalog_manager.cc:3411] renamed table default.table_8e881e3d74304c008c2588c42a082659 [id=98d2e7b647544a97b50827a0cb2799a0] in HMS: new name default.table_19c624001d444b7b9939e22128c594aa
I20260620 14:47:50.732837 9083 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.007s sys 0.003s
I20260620 14:47:50.733036 9083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data,/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
uuid: "caa9dcf251944f7d97f4ed7f3d83af44"
format_stamp: "Formatted at 2026-06-20 14:47:46 on dist-test-slave-c599"
I20260620 14:47:50.734477 9083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260620 14:47:50.736212 8322 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_bb493f9370e74bafae7b1e42f5c5f770 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 14:47:50.737299 8325 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_fdbead99862d49af98df44683e830bf5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 14:47:50.738132 8326 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_1ea7c21a49a443c29bd5578c5950c27f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 14:47:50.738930 8323 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_98318448fcf3484cb76812dad2975098 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 14:47:50.754865 8527 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1ad679f398ab41a1bc207b016648cbe8 consensus state has no leader
I20260620 14:47:50.756983 8331 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:59860 (request call id 11) took 1209 ms. Trace:
I20260620 14:47:50.757611 8331 rpcz_store.cc:276] 0620 14:47:49.547961 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:49.548041 (+ 80us) service_pool.cc:227] Handling call
0620 14:47:50.357535 (+809494us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 14:47:50.756277 (+398742us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 14:47:50.756626 (+ 349us) catalog_manager.cc:3616] Apply alter schema
0620 14:47:50.756939 (+ 313us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":12323,"Hive Metastore.run_cpu_time_us":1458,"Hive Metastore.run_wall_time_us":361992,"spinlock_wait_cycles":192896}
I20260620 14:47:50.758785 8331 catalog_manager.cc:5495] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c reported cstate change: term changed from 0 to 1, leader changed from <none> to 36236dd5bd604ba2819038e525a3790c (127.7.222.194). New cstate: current_term: 1 leader_uuid: "36236dd5bd604ba2819038e525a3790c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } health_report { overall_health: HEALTHY } } }
I20260620 14:47:50.770447 8331 catalog_manager.cc:5495] T bd541e6a431348c7a506611681730fc5 P c0e6c57ab91e42bf9be3739c816916c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193). New cstate: current_term: 1 leader_uuid: "c0e6c57ab91e42bf9be3739c816916c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } health_report { overall_health: UNKNOWN } } }
I20260620 14:47:50.784533 8331 catalog_manager.cc:5495] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c reported cstate change: term changed from 0 to 1, leader changed from <none> to 36236dd5bd604ba2819038e525a3790c (127.7.222.194). New cstate: current_term: 1 leader_uuid: "36236dd5bd604ba2819038e525a3790c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } health_report { overall_health: HEALTHY } } }
I20260620 14:47:50.785277 8331 catalog_manager.cc:5495] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c reported cstate change: term changed from 0 to 1, leader changed from <none> to 36236dd5bd604ba2819038e525a3790c (127.7.222.194). New cstate: current_term: 1 leader_uuid: "36236dd5bd604ba2819038e525a3790c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } health_report { overall_health: UNKNOWN } } }
I20260620 14:47:50.785805 8331 catalog_manager.cc:5587] TS 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159) does not have the latest schema for tablet 1ad679f398ab41a1bc207b016648cbe8 (table default.table_19c624001d444b7b9939e22128c594aa [id=98d2e7b647544a97b50827a0cb2799a0]). Expected version 1 got 0
I20260620 14:47:50.786142 8331 catalog_manager.cc:5495] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c reported cstate change: term changed from 0 to 1, leader changed from <none> to 36236dd5bd604ba2819038e525a3790c (127.7.222.194). New cstate: current_term: 1 leader_uuid: "36236dd5bd604ba2819038e525a3790c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } health_report { overall_health: UNKNOWN } } }
I20260620 14:47:50.786804 8331 catalog_manager.cc:5495] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c reported cstate change: term changed from 0 to 1, leader changed from <none> to 36236dd5bd604ba2819038e525a3790c (127.7.222.194). New cstate: current_term: 1 leader_uuid: "36236dd5bd604ba2819038e525a3790c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } health_report { overall_health: UNKNOWN } } }
I20260620 14:47:50.800223 8331 catalog_manager.cc:5495] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193). New cstate: current_term: 1 leader_uuid: "c0e6c57ab91e42bf9be3739c816916c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } health_report { overall_health: UNKNOWN } } }
I20260620 14:47:50.800944 8331 catalog_manager.cc:5495] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193). New cstate: current_term: 1 leader_uuid: "c0e6c57ab91e42bf9be3739c816916c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } health_report { overall_health: UNKNOWN } } }
I20260620 14:47:50.811743 8331 catalog_manager.cc:5495] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c99207e35f8463292d71c371c9546b4 (127.7.222.195). New cstate: current_term: 1 leader_uuid: "6c99207e35f8463292d71c371c9546b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } health_report { overall_health: UNKNOWN } } }
I20260620 14:47:50.815786 8935 raft_consensus.cc:1261] T 1ad679f398ab41a1bc207b016648cbe8 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Refusing update from remote peer 36236dd5bd604ba2819038e525a3790c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:47:50.816601 9115 consensus_queue.cc:1035] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:50.834190 8661 raft_consensus.cc:1261] T 1ad679f398ab41a1bc207b016648cbe8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Refusing update from remote peer 36236dd5bd604ba2819038e525a3790c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:47:50.835276 9115 consensus_queue.cc:1035] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:50.836421 8331 master_service.cc:946] ReplaceTablet: received request to replace tablet bdd71e7f271c40d4b722f38d32b1ea1d from {username='slave'} at 127.0.0.1:59860
I20260620 14:47:50.854602 9141 mvcc.cc:205] Tried to move back new op lower bound from 7298936302848913408 to 7298936301373435904. Current Snapshot: MvccSnapshot[applied={T|T < 7298936302848913408}]
I20260620 14:47:50.855736 8331 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52: Sending DeleteTablet for 3 replicas of tablet bdd71e7f271c40d4b722f38d32b1ea1d
I20260620 14:47:50.857795 8641 tablet_service.cc:1514] Processing DeleteTablet for tablet bdd71e7f271c40d4b722f38d32b1ea1d with delete_type TABLET_DATA_DELETED (replaced by tablet a4552c4e15464f21a10b6c2d83f7ead8) from {username='slave'} at 127.0.0.1:52276
I20260620 14:47:50.861543 9083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:47:50.862699 9083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:47:50.863059 9083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:47:50.867319 8914 tablet_service.cc:1514] Processing DeleteTablet for tablet bdd71e7f271c40d4b722f38d32b1ea1d with delete_type TABLET_DATA_DELETED (replaced by tablet a4552c4e15464f21a10b6c2d83f7ead8) from {username='slave'} at 127.0.0.1:56438
I20260620 14:47:50.877774 8780 tablet_service.cc:1514] Processing DeleteTablet for tablet bdd71e7f271c40d4b722f38d32b1ea1d with delete_type TABLET_DATA_DELETED (replaced by tablet a4552c4e15464f21a10b6c2d83f7ead8) from {username='slave'} at 127.0.0.1:49700
I20260620 14:47:50.896867 8330 catalog_manager.cc:3411] renamed table default.table_c4d3487a7a79427b9d03ce0524ea33a8 [id=c514aca79062490a8b6a18021b07b2ff] in HMS: new name default.table_fe5ad6a8d59b4751bcbb6e1d0d4baedb
I20260620 14:47:50.900301 8640 tablet_service.cc:1467] Processing CreateTablet for tablet a4552c4e15464f21a10b6c2d83f7ead8 (DEFAULT_TABLE table=default.table_0210e4215f5f4663af08e8f4da05f3b3 [id=9c1e21a6c9244efba2e86bfa28264a0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:50.900564 8912 tablet_service.cc:1467] Processing CreateTablet for tablet a4552c4e15464f21a10b6c2d83f7ead8 (DEFAULT_TABLE table=default.table_0210e4215f5f4663af08e8f4da05f3b3 [id=9c1e21a6c9244efba2e86bfa28264a0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:50.900866 8640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4552c4e15464f21a10b6c2d83f7ead8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:50.901227 8912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4552c4e15464f21a10b6c2d83f7ead8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:50.908144 9049 tablet_bootstrap.cc:492] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:50.909029 8779 tablet_service.cc:1467] Processing CreateTablet for tablet a4552c4e15464f21a10b6c2d83f7ead8 (DEFAULT_TABLE table=default.table_0210e4215f5f4663af08e8f4da05f3b3 [id=9c1e21a6c9244efba2e86bfa28264a0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:50.909472 8779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4552c4e15464f21a10b6c2d83f7ead8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:50.909816 9049 tablet_bootstrap.cc:654] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:50.921221 9049 tablet_bootstrap.cc:492] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:50.921481 9049 ts_tablet_manager.cc:1397] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.006s
I20260620 14:47:50.922312 9049 raft_consensus.cc:348] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.922672 9049 raft_consensus.cc:374] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:50.922667 8331 catalog_manager.cc:6565] ReplaceTablet: tablet bdd71e7f271c40d4b722f38d32b1ea1d deleted and replaced by tablet a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:47:50.922813 9049 raft_consensus.cc:729] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:50.923144 9049 consensus_queue.cc:260] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:50.924805 8331 catalog_manager.cc:5587] TS 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279) does not have the latest schema for tablet 1ad679f398ab41a1bc207b016648cbe8 (table default.table_19c624001d444b7b9939e22128c594aa [id=98d2e7b647544a97b50827a0cb2799a0]). Expected version 1 got 0
I20260620 14:47:50.924868 9049 ts_tablet_manager.cc:1428] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260620 14:47:50.928376 8331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59860:
name: "default.Table_2d00c2dfdbfe428a8de80587e6f6e918"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:50.951298 9153 tablet_bootstrap.cc:492] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:50.953384 9150 tablet_replica.cc:330] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c: stopping tablet replica
I20260620 14:47:50.954064 9150 raft_consensus.cc:2229] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:47:50.954603 9150 pending_rounds.cc:62] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c: Trying to abort 1 pending ops.
I20260620 14:47:50.954761 9150 pending_rounds.cc:68] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298936301429940224 op_type: NO_OP noop_request { }
I20260620 14:47:50.954942 9150 raft_consensus.cc:2866] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 14:47:50.955067 9150 raft_consensus.cc:2258] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:50.956154 9150 ts_tablet_manager.cc:1905] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:50.961210 9147 tablet_replica.cc:330] T bdd71e7f271c40d4b722f38d32b1ea1d P c0e6c57ab91e42bf9be3739c816916c0: stopping tablet replica
I20260620 14:47:50.961468 9147 raft_consensus.cc:2229] T bdd71e7f271c40d4b722f38d32b1ea1d P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:50.961763 9147 raft_consensus.cc:2258] T bdd71e7f271c40d4b722f38d32b1ea1d P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:50.962405 9147 ts_tablet_manager.cc:1905] T bdd71e7f271c40d4b722f38d32b1ea1d P c0e6c57ab91e42bf9be3739c816916c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:50.965278 9149 tablet_replica.cc:330] T bdd71e7f271c40d4b722f38d32b1ea1d P 6c99207e35f8463292d71c371c9546b4: stopping tablet replica
I20260620 14:47:50.965662 9149 raft_consensus.cc:2229] T bdd71e7f271c40d4b722f38d32b1ea1d P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:50.966178 9149 raft_consensus.cc:2258] T bdd71e7f271c40d4b722f38d32b1ea1d P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:50.966843 9149 ts_tablet_manager.cc:1905] T bdd71e7f271c40d4b722f38d32b1ea1d P 6c99207e35f8463292d71c371c9546b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:50.969440 9152 tablet_bootstrap.cc:492] T a4552c4e15464f21a10b6c2d83f7ead8 P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:50.971496 9152 tablet_bootstrap.cc:654] T a4552c4e15464f21a10b6c2d83f7ead8 P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:50.974923 9145 tablet.cc:1722] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 14:47:51.000624 9153 tablet_bootstrap.cc:654] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:51.002127 9154 tablet.cc:1722] T 1ad679f398ab41a1bc207b016648cbe8 P 6c99207e35f8463292d71c371c9546b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 14:47:51.015249 9153 tablet_bootstrap.cc:492] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:51.015430 9153 ts_tablet_manager.cc:1397] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.064s user 0.004s sys 0.000s
I20260620 14:47:51.016239 9153 raft_consensus.cc:348] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.016507 9153 raft_consensus.cc:374] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:51.017050 9153 raft_consensus.cc:729] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:51.017488 9153 consensus_queue.cc:260] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.019083 9153 ts_tablet_manager.cc:1428] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260620 14:47:51.036716 9143 mvcc.cc:205] Tried to move back new op lower bound from 7298936302848913408 to 7298936301373435904. Current Snapshot: MvccSnapshot[applied={T|T < 7298936302848913408}]
I20260620 14:47:51.039263 9158 tablet.cc:1722] T 1ad679f398ab41a1bc207b016648cbe8 P c0e6c57ab91e42bf9be3739c816916c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 14:47:51.049775 9152 tablet_bootstrap.cc:492] T a4552c4e15464f21a10b6c2d83f7ead8 P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:51.049964 9152 ts_tablet_manager.cc:1397] T a4552c4e15464f21a10b6c2d83f7ead8 P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.081s user 0.000s sys 0.003s
I20260620 14:47:51.050850 9152 raft_consensus.cc:348] T a4552c4e15464f21a10b6c2d83f7ead8 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.051146 9152 raft_consensus.cc:374] T a4552c4e15464f21a10b6c2d83f7ead8 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:51.051244 9152 raft_consensus.cc:729] T a4552c4e15464f21a10b6c2d83f7ead8 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:51.051512 9152 consensus_queue.cc:260] T a4552c4e15464f21a10b6c2d83f7ead8 P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.052309 9152 ts_tablet_manager.cc:1428] T a4552c4e15464f21a10b6c2d83f7ead8 P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260620 14:47:51.064522 9149 ts_tablet_manager.cc:1918] T bdd71e7f271c40d4b722f38d32b1ea1d P 6c99207e35f8463292d71c371c9546b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 14:47:51.064678 9149 log.cc:1196] T bdd71e7f271c40d4b722f38d32b1ea1d P 6c99207e35f8463292d71c371c9546b4: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal/wals/bdd71e7f271c40d4b722f38d32b1ea1d
I20260620 14:47:51.066831 9149 ts_tablet_manager.cc:1939] T bdd71e7f271c40d4b722f38d32b1ea1d P 6c99207e35f8463292d71c371c9546b4: Deleting consensus metadata
I20260620 14:47:51.067203 9147 ts_tablet_manager.cc:1918] T bdd71e7f271c40d4b722f38d32b1ea1d P c0e6c57ab91e42bf9be3739c816916c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 14:47:51.067363 9147 log.cc:1196] T bdd71e7f271c40d4b722f38d32b1ea1d P c0e6c57ab91e42bf9be3739c816916c0: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/wal/wals/bdd71e7f271c40d4b722f38d32b1ea1d
I20260620 14:47:51.067787 9147 ts_tablet_manager.cc:1939] T bdd71e7f271c40d4b722f38d32b1ea1d P c0e6c57ab91e42bf9be3739c816916c0: Deleting consensus metadata
I20260620 14:47:51.068044 8316 catalog_manager.cc:4841] TS 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): tablet bdd71e7f271c40d4b722f38d32b1ea1d (table default.table_0210e4215f5f4663af08e8f4da05f3b3 [id=9c1e21a6c9244efba2e86bfa28264a0d]) successfully deleted
I20260620 14:47:51.071328 9150 ts_tablet_manager.cc:1918] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:51.071512 9150 log.cc:1196] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal/wals/bdd71e7f271c40d4b722f38d32b1ea1d
I20260620 14:47:51.072013 9150 ts_tablet_manager.cc:1939] T bdd71e7f271c40d4b722f38d32b1ea1d P 36236dd5bd604ba2819038e525a3790c: Deleting consensus metadata
I20260620 14:47:51.073396 8318 catalog_manager.cc:4841] TS 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): tablet bdd71e7f271c40d4b722f38d32b1ea1d (table default.table_0210e4215f5f4663af08e8f4da05f3b3 [id=9c1e21a6c9244efba2e86bfa28264a0d]) successfully deleted
I20260620 14:47:51.074604 8316 catalog_manager.cc:4841] TS c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821): tablet bdd71e7f271c40d4b722f38d32b1ea1d (table default.table_0210e4215f5f4663af08e8f4da05f3b3 [id=9c1e21a6c9244efba2e86bfa28264a0d]) successfully deleted
I20260620 14:47:51.082705 9083 rpc_server.cc:307] RPC server started. Bound to: 127.7.222.253:34209
I20260620 14:47:51.082674 9203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.222.253:34209 every 8 connection(s)
I20260620 14:47:51.084856 9083 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data/info.pb
I20260620 14:47:51.087661 8059 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9VKlbC/build/asan/bin/kudu as pid 9083
I20260620 14:47:51.106838 9204 sys_catalog.cc:263] Verifying existing consensus state
I20260620 14:47:51.114349 9204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Bootstrap starting.
I20260620 14:47:51.120622 8324 catalog_manager.cc:3411] renamed table default.table_b702c9d170e842fa824a76fb4be199fb [id=c65e926af55d4fbba6c42f4d2ddbb397] in HMS: new name default.table_a901d915c377429a9e43cfcaf071e7d3
I20260620 14:47:51.127339 9204 log.cc:824] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Log is configured to *not* fsync() on all Append() calls
I20260620 14:47:51.135361 9204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 14:47:51.135931 9204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Bootstrap complete.
I20260620 14:47:51.144917 9204 raft_consensus.cc:348] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:51.146040 9204 raft_consensus.cc:729] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa9dcf251944f7d97f4ed7f3d83af44, State: Initialized, Role: FOLLOWER
I20260620 14:47:51.146126 9102 consensus_queue.cc:1035] T bd541e6a431348c7a506611681730fc5 P c0e6c57ab91e42bf9be3739c816916c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:51.146823 9204 consensus_queue.cc:260] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:51.147722 9208 sys_catalog.cc:455] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:51.148223 9208 sys_catalog.cc:458] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:47:51.149209 9204 sys_catalog.cc:564] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:47:51.158053 8982 heartbeater.cc:347] Connected to a master server at 127.7.222.253:34209
I20260620 14:47:51.171451 9062 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:51.171676 9062 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.171833 9103 consensus_queue.cc:1035] T bd541e6a431348c7a506611681730fc5 P c0e6c57ab91e42bf9be3739c816916c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:51.172415 9062 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:51.176039 8661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4552c4e15464f21a10b6c2d83f7ead8" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:47:51.176316 8661 raft_consensus.cc:2454] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:51.178767 8869 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:51.182968 8800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4552c4e15464f21a10b6c2d83f7ead8" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:47:51.183223 8800 raft_consensus.cc:2454] T a4552c4e15464f21a10b6c2d83f7ead8 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:51.184665 8709 heartbeater.cc:347] Connected to a master server at 127.7.222.253:34209
I20260620 14:47:51.187568 9062 raft_consensus.cc:2781] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:51.187709 9062 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:51.187824 9062 raft_consensus.cc:3037] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:51.190744 9062 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.199570 8847 heartbeater.cc:347] Connected to a master server at 127.7.222.253:34209
I20260620 14:47:51.199669 8661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4552c4e15464f21a10b6c2d83f7ead8" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:47:51.199906 8661 raft_consensus.cc:3037] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:51.199990 9224 consensus_queue.cc:1035] T 675413dc550f485dbef0d180ed27ff0e P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:51.201304 9062 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Requested vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:51.202898 8661 raft_consensus.cc:2454] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:51.203892 8869 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:51.205528 9062 raft_consensus.cc:2781] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:51.205721 9062 raft_consensus.cc:686] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Becoming Leader. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Running, Role: LEADER
I20260620 14:47:51.206082 9062 consensus_queue.cc:237] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.213387 8800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4552c4e15464f21a10b6c2d83f7ead8" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:47:51.213680 8800 raft_consensus.cc:3037] T a4552c4e15464f21a10b6c2d83f7ead8 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:51.219142 8800 raft_consensus.cc:2454] T a4552c4e15464f21a10b6c2d83f7ead8 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:51.237653 9169 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "36236dd5bd604ba2819038e525a3790c" instance_seqno: 1781966868431821) as {username='slave'} at 127.7.222.194:45029; Asking this server to re-register.
I20260620 14:47:51.239714 8847 heartbeater.cc:464] Registering TS with master...
I20260620 14:47:51.239521 9228 consensus_queue.cc:1035] T 675413dc550f485dbef0d180ed27ff0e P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:51.242414 9169 ts_manager.cc:194] Registered new tserver with Master: 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:51.252696 9169 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6c99207e35f8463292d71c371c9546b4" instance_seqno: 1781966868961030) as {username='slave'} at 127.7.222.195:59633; Asking this server to re-register.
I20260620 14:47:51.254042 8982 heartbeater.cc:464] Registering TS with master...
I20260620 14:47:51.256201 9168 ts_manager.cc:194] Registered new tserver with Master: 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:47:51.269344 9115 consensus_queue.cc:1035] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:51.275194 9227 catalog_manager.cc:1259] Loaded cluster ID: 700994c053c643c896af12c77a108604
I20260620 14:47:51.275305 9227 catalog_manager.cc:1552] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: loading cluster ID for follower catalog manager: success
I20260620 14:47:51.282025 9169 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" instance_seqno: 1781966867942712) as {username='slave'} at 127.7.222.193:54871; Asking this server to re-register.
I20260620 14:47:51.283422 8709 heartbeater.cc:464] Registering TS with master...
I20260620 14:47:51.285310 9169 ts_manager.cc:194] Registered new tserver with Master: c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:47:51.288059 9227 catalog_manager.cc:1574] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: acquiring CA information for follower catalog manager: success
I20260620 14:47:51.291033 9054 consensus_queue.cc:1035] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:51.301172 9227 catalog_manager.cc:1602] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 14:47:51.309470 8328 catalog_manager.cc:3411] renamed table default.table_0210e4215f5f4663af08e8f4da05f3b3 [id=9c1e21a6c9244efba2e86bfa28264a0d] in HMS: new name default.table_e8372b71bacb4865b4360a50af59d323
I20260620 14:47:51.382202 8327 catalog_manager.cc:3411] renamed table default.table_116796b0dc6c4dbd97c4f0c519f6d18f [id=0c4867ea1c1e45f388ccd4e2c9de093e] in HMS: new name default.table_4ab72ecdb6d540508f6f4b250020b540
I20260620 14:47:51.418685 9208 sys_catalog.cc:455] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd308569015348a7a19ba4a560de6d52. Latest consensus state: current_term: 1 leader_uuid: "dd308569015348a7a19ba4a560de6d52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:51.419101 9208 sys_catalog.cc:458] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:47:51.432152 8322 catalog_manager.cc:2148] created HMS catalog entry for table [id=6a722b39b30e45649b7b70c32c9e2260]
I20260620 14:47:51.451272 9103 consensus_queue.cc:1035] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:51.460007 9224 consensus_queue.cc:1035] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:51.469420 9102 consensus_queue.cc:1035] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:51.480551 9228 consensus_queue.cc:1035] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:51.511744 9248 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dd308569015348a7a19ba4a560de6d52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:51.512056 9248 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: This master's current role is: LEADER
I20260620 14:47:51.517534 8322 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:59860 (request call id 20) took 1770 ms. Trace:
I20260620 14:47:51.520676 8322 rpcz_store.cc:276] 0620 14:47:49.746861 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:49.821574 (+ 74713us) service_pool.cc:227] Handling call
0620 14:47:50.736346 (+914772us) catalog_manager.cc:2075] Acquired catalog manager lock
0620 14:47:50.736891 (+ 545us) catalog_manager.cc:2121] Created new table and tablet info
0620 14:47:51.432115 (+695224us) catalog_manager.cc:2147] Created new table in HMS catalog
0620 14:47:51.513986 (+ 81871us) catalog_manager.cc:2181] Wrote table and tablets to system table
0620 14:47:51.514101 (+ 115us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0620 14:47:51.517480 (+ 3379us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 14:47:51.439434 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 14:47:51.439561 (+ 127us) write_op.cc:432] Acquiring schema lock in shared mode
0620 14:47:51.439566 (+ 5us) write_op.cc:435] Acquired schema lock
0620 14:47:51.439568 (+ 2us) tablet.cc:660] Decoding operations
0620 14:47:51.442229 (+ 2661us) write_op.cc:620] Acquiring the partition lock for write op
0620 14:47:51.442247 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0620 14:47:51.442253 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
0620 14:47:51.442349 (+ 96us) tablet.cc:699] Row locks acquired
0620 14:47:51.442351 (+ 2us) write_op.cc:260] PREPARE: finished
0620 14:47:51.442397 (+ 46us) write_op.cc:270] Start()
0620 14:47:51.442436 (+ 39us) write_op.cc:276] Timestamp: P: 1781966871442375 usec, L: 0
0620 14:47:51.442440 (+ 4us) op_driver.cc:331] REPLICATION: starting
0620 14:47:51.442684 (+ 244us) log.cc:842] Serialized 432 byte log entry
0620 14:47:51.511547 (+ 68863us) spinlock_profiling.cc:243] Waited 49 ms on lock 0x6160000229a0. stack: 00007f929b55e66e 00007f929b55e430 00007f929a5e55ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f92a69cdda9 00007f92a69d3114 00007f92a69d2ed8 00000000009edb7c 00007f929b5a4344 00007f929b5a791b 00007f929b5a7798 00000000009edb7c 00007f929b582eae 00007f929e85c6da
0620 14:47:51.512731 (+ 1184us) op_driver.cc:444] REPLICATION: finished
0620 14:47:51.513241 (+ 510us) write_op.cc:301] APPLY: starting
0620 14:47:51.513264 (+ 23us) tablet.cc:1365] starting BulkCheckPresence
0620 14:47:51.513317 (+ 53us) tablet.cc:1368] finished BulkCheckPresence
0620 14:47:51.513320 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 14:47:51.513467 (+ 147us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 14:47:51.513506 (+ 39us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0620 14:47:51.513518 (+ 12us) write_op.cc:312] APPLY: finished
0620 14:47:51.513628 (+ 110us) log.cc:842] Serialized 28 byte log entry
0620 14:47:51.513721 (+ 93us) write_op.cc:489] Releasing partition, row and schema locks
0620 14:47:51.513744 (+ 23us) write_op.cc:454] Released schema lock
0620 14:47:51.513752 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0620 14:47:51.513814 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0620 14:47:51.513817 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":645051,"Hive Metastore.run_cpu_time_us":294,"Hive Metastore.run_wall_time_us":49735,"child_traces":[["op",{"apply.queue_time_us":418,"apply.run_cpu_time_us":637,"apply.run_wall_time_us":637,"mutex_wait_us":2191,"num_ops":2,"prepare.queue_time_us":6551,"prepare.run_cpu_time_us":957,"prepare.run_wall_time_us":5647,"raft.queue_time_us":19263,"raft.run_cpu_time_us":6726,"raft.run_wall_time_us":114041,"replication_time_us":70262,"spinlock_wait_cycles":112833536,"thread_start_us":70727,"threads_started":4}]]}
I20260620 14:47:51.526060 8325 catalog_manager.cc:2148] created HMS catalog entry for table [id=85b633c4801d49bd9ad9b944b178e683]
I20260620 14:47:51.530570 8641 tablet_service.cc:1467] Processing CreateTablet for tablet 8caaa1b5e0384a6ab49b9fd7162896c8 (DEFAULT_TABLE table=default.table_bb493f9370e74bafae7b1e42f5c5f770 [id=6a722b39b30e45649b7b70c32c9e2260]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:51.531122 8641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8caaa1b5e0384a6ab49b9fd7162896c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:51.538426 8912 tablet_service.cc:1467] Processing CreateTablet for tablet 8caaa1b5e0384a6ab49b9fd7162896c8 (DEFAULT_TABLE table=default.table_bb493f9370e74bafae7b1e42f5c5f770 [id=6a722b39b30e45649b7b70c32c9e2260]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:51.538977 8912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8caaa1b5e0384a6ab49b9fd7162896c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:51.542029 8780 tablet_service.cc:1467] Processing CreateTablet for tablet 8caaa1b5e0384a6ab49b9fd7162896c8 (DEFAULT_TABLE table=default.table_bb493f9370e74bafae7b1e42f5c5f770 [id=6a722b39b30e45649b7b70c32c9e2260]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:51.542505 8780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8caaa1b5e0384a6ab49b9fd7162896c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:51.553640 9152 tablet_bootstrap.cc:492] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:51.555967 9152 tablet_bootstrap.cc:654] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:51.563354 8326 catalog_manager.cc:2148] created HMS catalog entry for table [id=bfa17da52a874fa1b587ad18d04cd740]
I20260620 14:47:51.565901 8325 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:59860 (request call id 21) took 1812 ms. Trace:
I20260620 14:47:51.566039 8325 rpcz_store.cc:276] 0620 14:47:49.753108 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:50.022364 (+269256us) service_pool.cc:227] Handling call
0620 14:47:50.737416 (+715052us) catalog_manager.cc:2075] Acquired catalog manager lock
0620 14:47:50.737835 (+ 419us) catalog_manager.cc:2121] Created new table and tablet info
0620 14:47:51.526025 (+788190us) catalog_manager.cc:2147] Created new table in HMS catalog
0620 14:47:51.565565 (+ 39540us) catalog_manager.cc:2181] Wrote table and tablets to system table
0620 14:47:51.565691 (+ 126us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0620 14:47:51.565797 (+ 106us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 14:47:51.527156 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 14:47:51.527280 (+ 124us) write_op.cc:432] Acquiring schema lock in shared mode
0620 14:47:51.527286 (+ 6us) write_op.cc:435] Acquired schema lock
0620 14:47:51.527289 (+ 3us) tablet.cc:660] Decoding operations
0620 14:47:51.527372 (+ 83us) write_op.cc:620] Acquiring the partition lock for write op
0620 14:47:51.527383 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0620 14:47:51.527388 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0620 14:47:51.527470 (+ 82us) tablet.cc:699] Row locks acquired
0620 14:47:51.527472 (+ 2us) write_op.cc:260] PREPARE: finished
0620 14:47:51.527506 (+ 34us) write_op.cc:270] Start()
0620 14:47:51.527537 (+ 31us) write_op.cc:276] Timestamp: P: 1781966871527477 usec, L: 0
0620 14:47:51.527541 (+ 4us) op_driver.cc:331] REPLICATION: starting
0620 14:47:51.527698 (+ 157us) log.cc:842] Serialized 432 byte log entry
0620 14:47:51.563300 (+ 35602us) op_driver.cc:444] REPLICATION: finished
0620 14:47:51.563942 (+ 642us) write_op.cc:301] APPLY: starting
0620 14:47:51.563954 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
0620 14:47:51.563993 (+ 39us) tablet.cc:1368] finished BulkCheckPresence
0620 14:47:51.564038 (+ 45us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 14:47:51.564188 (+ 150us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 14:47:51.564236 (+ 48us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0620 14:47:51.564247 (+ 11us) write_op.cc:312] APPLY: finished
0620 14:47:51.564378 (+ 131us) log.cc:842] Serialized 28 byte log entry
0620 14:47:51.564439 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0620 14:47:51.564463 (+ 24us) write_op.cc:454] Released schema lock
0620 14:47:51.564472 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0620 14:47:51.564542 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0620 14:47:51.564549 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":693973,"Hive Metastore.run_cpu_time_us":282,"Hive Metastore.run_wall_time_us":93780,"child_traces":[["op",{"apply.queue_time_us":609,"apply.run_cpu_time_us":658,"apply.run_wall_time_us":658,"num_ops":2,"prepare.queue_time_us":535,"prepare.run_cpu_time_us":609,"prepare.run_wall_time_us":610,"replication_time_us":35743,"threads_started":1}]]}
I20260620 14:47:51.567912 8322 catalog_manager.cc:6040] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52: default.table_19c624001d444b7b9939e22128c594aa [id=98d2e7b647544a97b50827a0cb2799a0] alter complete (version 1)
I20260620 14:47:51.569604 9258 tablet_bootstrap.cc:492] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:51.571957 9258 tablet_bootstrap.cc:654] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:51.575448 9152 tablet_bootstrap.cc:492] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:51.575680 9152 ts_tablet_manager.cc:1397] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.006s
I20260620 14:47:51.576574 9152 raft_consensus.cc:348] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.576897 9152 raft_consensus.cc:374] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:51.576985 9152 raft_consensus.cc:729] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:51.577251 9152 consensus_queue.cc:260] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.577452 9054 consensus_queue.cc:1035] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:51.577893 9152 ts_tablet_manager.cc:1428] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 14:47:51.601804 8325 catalog_manager.cc:5587] TS 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279) does not have the latest schema for tablet 1ad679f398ab41a1bc207b016648cbe8 (table default.table_19c624001d444b7b9939e22128c594aa [id=98d2e7b647544a97b50827a0cb2799a0]). Expected version 1 got 0
I20260620 14:47:51.605942 8322 catalog_manager.cc:5587] TS c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821) does not have the latest schema for tablet 1ad679f398ab41a1bc207b016648cbe8 (table default.table_19c624001d444b7b9939e22128c594aa [id=98d2e7b647544a97b50827a0cb2799a0]). Expected version 1 got 0
I20260620 14:47:51.606649 8322 master_service.cc:946] ReplaceTablet: received request to replace tablet 514af46a4b0c4c2f8e27b65a1322e976 from {username='slave'} at 127.0.0.1:59860
I20260620 14:47:51.607021 8322 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:59860 (request call id 29) took 1622 ms. Trace:
I20260620 14:47:51.609408 8322 rpcz_store.cc:276] 0620 14:47:49.984515 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:51.606579 (+1622064us) service_pool.cc:227] Handling call
0620 14:47:51.606967 (+ 388us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 14:47:51.612426 8322 master_service.cc:946] ReplaceTablet: received request to replace tablet 79da710506b745fb8e807b52a9dc54ab from {username='slave'} at 127.0.0.1:59860
I20260620 14:47:51.618883 8326 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:59860 (request call id 23) took 1802 ms. Trace:
I20260620 14:47:51.619010 8326 rpcz_store.cc:276] 0620 14:47:49.816102 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:50.262783 (+446681us) service_pool.cc:227] Handling call
0620 14:47:50.738243 (+475460us) catalog_manager.cc:2075] Acquired catalog manager lock
0620 14:47:50.738619 (+ 376us) catalog_manager.cc:2121] Created new table and tablet info
0620 14:47:51.563285 (+824666us) catalog_manager.cc:2147] Created new table in HMS catalog
0620 14:47:51.618611 (+ 55326us) catalog_manager.cc:2181] Wrote table and tablets to system table
0620 14:47:51.618726 (+ 115us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0620 14:47:51.618817 (+ 91us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 14:47:51.565124 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 14:47:51.565267 (+ 143us) write_op.cc:432] Acquiring schema lock in shared mode
0620 14:47:51.565275 (+ 8us) write_op.cc:435] Acquired schema lock
0620 14:47:51.565278 (+ 3us) tablet.cc:660] Decoding operations
0620 14:47:51.565424 (+ 146us) write_op.cc:620] Acquiring the partition lock for write op
0620 14:47:51.565443 (+ 19us) write_op.cc:641] Partition lock acquired for write op
0620 14:47:51.565452 (+ 9us) tablet.cc:683] Acquiring locks for 2 operations
0620 14:47:51.565570 (+ 118us) tablet.cc:699] Row locks acquired
0620 14:47:51.565575 (+ 5us) write_op.cc:260] PREPARE: finished
0620 14:47:51.565622 (+ 47us) write_op.cc:270] Start()
0620 14:47:51.565657 (+ 35us) write_op.cc:276] Timestamp: P: 1781966871565585 usec, L: 0
0620 14:47:51.565662 (+ 5us) op_driver.cc:331] REPLICATION: starting
0620 14:47:51.605855 (+ 40193us) log.cc:842] Serialized 432 byte log entry
0620 14:47:51.606194 (+ 339us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x615000033024. stack: 00007f929b55e66e 00007f929b55e430 00007f929a5e55ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f92a6a6cd02 00007f92a7d9f7f1 00007f92a7d9e359 00007f92a7da61bb 00007f92a7da6038 00000000009edb7c 00007f929b5a4344 00007f929b5a791b 00007f929b5a7798 00000000009edb7c
0620 14:47:51.613363 (+ 7169us) op_driver.cc:444] REPLICATION: finished
0620 14:47:51.617791 (+ 4428us) write_op.cc:301] APPLY: starting
0620 14:47:51.617806 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0620 14:47:51.617849 (+ 43us) tablet.cc:1368] finished BulkCheckPresence
0620 14:47:51.617852 (+ 3us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 14:47:51.618025 (+ 173us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 14:47:51.618059 (+ 34us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0620 14:47:51.618066 (+ 7us) write_op.cc:312] APPLY: finished
0620 14:47:51.618155 (+ 89us) log.cc:842] Serialized 28 byte log entry
0620 14:47:51.618388 (+ 233us) write_op.cc:489] Releasing partition, row and schema locks
0620 14:47:51.618407 (+ 19us) write_op.cc:454] Released schema lock
0620 14:47:51.618414 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0620 14:47:51.618478 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0620 14:47:51.618484 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":787008,"Hive Metastore.run_cpu_time_us":386,"Hive Metastore.run_wall_time_us":37183,"child_traces":[["op",{"apply.queue_time_us":4365,"apply.run_cpu_time_us":578,"apply.run_wall_time_us":746,"num_ops":2,"prepare.queue_time_us":573,"prepare.run_cpu_time_us":1688,"prepare.run_wall_time_us":41406,"raft.queue_time_us":2206,"raft.run_cpu_time_us":432,"raft.run_wall_time_us":433,"replication_time_us":47675,"spinlock_wait_cycles":91915008}]]}
I20260620 14:47:51.629954 8640 tablet_service.cc:1467] Processing CreateTablet for tablet 493a30104eab4762a3f4ffae3491765e (DEFAULT_TABLE table=default.table_fdbead99862d49af98df44683e830bf5 [id=85b633c4801d49bd9ad9b944b178e683]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:51.630400 8640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 493a30104eab4762a3f4ffae3491765e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:51.630820 8780 tablet_service.cc:1467] Processing CreateTablet for tablet 493a30104eab4762a3f4ffae3491765e (DEFAULT_TABLE table=default.table_fdbead99862d49af98df44683e830bf5 [id=85b633c4801d49bd9ad9b944b178e683]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:51.631207 8780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 493a30104eab4762a3f4ffae3491765e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:51.638754 8322 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52: Sending DeleteTablet for 3 replicas of tablet 79da710506b745fb8e807b52a9dc54ab
I20260620 14:47:51.639591 8779 tablet_service.cc:1514] Processing DeleteTablet for tablet 79da710506b745fb8e807b52a9dc54ab with delete_type TABLET_DATA_DELETED (replaced by tablet eb6d101c1a5444cabf7c966c7ac7134e) from {username='slave'} at 127.0.0.1:49700
I20260620 14:47:51.639602 8642 tablet_service.cc:1514] Processing DeleteTablet for tablet 79da710506b745fb8e807b52a9dc54ab with delete_type TABLET_DATA_DELETED (replaced by tablet eb6d101c1a5444cabf7c966c7ac7134e) from {username='slave'} at 127.0.0.1:52276
I20260620 14:47:51.640839 8323 catalog_manager.cc:2148] created HMS catalog entry for table [id=862dd3cee25c40eead9feb394a8b58b1]
I20260620 14:47:51.644508 8322 catalog_manager.cc:6565] ReplaceTablet: tablet 79da710506b745fb8e807b52a9dc54ab deleted and replaced by tablet eb6d101c1a5444cabf7c966c7ac7134e
I20260620 14:47:51.644636 8322 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:59860 (request call id 30) took 1624 ms. Trace:
I20260620 14:47:51.645015 8914 tablet_service.cc:1514] Processing DeleteTablet for tablet 79da710506b745fb8e807b52a9dc54ab with delete_type TABLET_DATA_DELETED (replaced by tablet eb6d101c1a5444cabf7c966c7ac7134e) from {username='slave'} at 127.0.0.1:56438
I20260620 14:47:51.644732 8322 rpcz_store.cc:276] 0620 14:47:50.020033 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:51.612334 (+1592301us) service_pool.cc:227] Handling call
0620 14:47:51.644608 (+ 32274us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 14:47:51.623658 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 14:47:51.623746 (+ 88us) write_op.cc:432] Acquiring schema lock in shared mode
0620 14:47:51.623751 (+ 5us) write_op.cc:435] Acquired schema lock
0620 14:47:51.623753 (+ 2us) tablet.cc:660] Decoding operations
0620 14:47:51.623845 (+ 92us) write_op.cc:620] Acquiring the partition lock for write op
0620 14:47:51.623854 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0620 14:47:51.623858 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0620 14:47:51.623922 (+ 64us) tablet.cc:699] Row locks acquired
0620 14:47:51.623924 (+ 2us) write_op.cc:260] PREPARE: finished
0620 14:47:51.623951 (+ 27us) write_op.cc:270] Start()
0620 14:47:51.623974 (+ 23us) write_op.cc:276] Timestamp: P: 1781966871623917 usec, L: 0
0620 14:47:51.623978 (+ 4us) op_driver.cc:331] REPLICATION: starting
0620 14:47:51.624113 (+ 135us) log.cc:842] Serialized 661 byte log entry
0620 14:47:51.627821 (+ 3708us) op_driver.cc:444] REPLICATION: finished
0620 14:47:51.628331 (+ 510us) write_op.cc:301] APPLY: starting
0620 14:47:51.628340 (+ 9us) tablet.cc:1365] starting BulkCheckPresence
0620 14:47:51.628369 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
0620 14:47:51.628387 (+ 18us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 14:47:51.628474 (+ 87us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 14:47:51.628522 (+ 48us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0620 14:47:51.628527 (+ 5us) write_op.cc:312] APPLY: finished
0620 14:47:51.628575 (+ 48us) log.cc:842] Serialized 28 byte log entry
0620 14:47:51.628613 (+ 38us) write_op.cc:489] Releasing partition, row and schema locks
0620 14:47:51.628627 (+ 14us) write_op.cc:454] Released schema lock
0620 14:47:51.628632 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0620 14:47:51.628677 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0620 14:47:51.628680 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":479,"apply.run_cpu_time_us":384,"apply.run_wall_time_us":384,"num_ops":2,"prepare.queue_time_us":664,"prepare.run_cpu_time_us":569,"prepare.run_wall_time_us":12884,"raft.queue_time_us":333,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":3823}]]}
I20260620 14:47:51.646078 9265 tablet_replica.cc:330] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0: stopping tablet replica
I20260620 14:47:51.646374 9265 raft_consensus.cc:2229] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:47:51.646746 8322 master_service.cc:946] ReplaceTablet: received request to replace tablet 79da710506b745fb8e807b52a9dc54ab from {username='slave'} at 127.0.0.1:59860
I20260620 14:47:51.646821 9265 pending_rounds.cc:62] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0: Trying to abort 1 pending ops.
I20260620 14:47:51.646948 9265 pending_rounds.cc:68] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298936302478921728 op_type: NO_OP noop_request { }
I20260620 14:47:51.647185 8322 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:59860 (request call id 31) took 1622 ms. Trace:
I20260620 14:47:51.647181 9265 raft_consensus.cc:2866] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 14:47:51.647333 9265 raft_consensus.cc:2258] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:51.647306 8322 rpcz_store.cc:276] 0620 14:47:50.025061 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:51.646680 (+1621619us) service_pool.cc:227] Handling call
0620 14:47:51.647132 (+ 452us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 14:47:51.648698 8322 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59860:
table { table_name: "default.Table_1d0410429a7242ab85d16d800ffd0502" } modify_external_catalogs: true
I20260620 14:47:51.649358 8322 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59860:
table { table_name: "default.Table_1d0410429a7242ab85d16d800ffd0502" } modify_external_catalogs: true
I20260620 14:47:51.649521 9264 tablet_replica.cc:330] T 79da710506b745fb8e807b52a9dc54ab P 36236dd5bd604ba2819038e525a3790c: stopping tablet replica
I20260620 14:47:51.649740 9264 raft_consensus.cc:2229] T 79da710506b745fb8e807b52a9dc54ab P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:51.649966 9264 raft_consensus.cc:2258] T 79da710506b745fb8e807b52a9dc54ab P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:51.650539 9264 ts_tablet_manager.cc:1905] T 79da710506b745fb8e807b52a9dc54ab P 36236dd5bd604ba2819038e525a3790c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:51.651971 9152 tablet_bootstrap.cc:492] T 493a30104eab4762a3f4ffae3491765e P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:51.653843 9152 tablet_bootstrap.cc:654] T 493a30104eab4762a3f4ffae3491765e P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:51.656432 8326 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59860:
name: "default.Table_96a3abe199c94222aea451130599b401"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:51.662845 8323 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:59860 (request call id 24) took 1774 ms. Trace:
I20260620 14:47:51.663005 8323 rpcz_store.cc:276] 0620 14:47:49.888421 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:50.284824 (+396403us) service_pool.cc:227] Handling call
0620 14:47:50.739042 (+454218us) catalog_manager.cc:2075] Acquired catalog manager lock
0620 14:47:50.739348 (+ 306us) catalog_manager.cc:2121] Created new table and tablet info
0620 14:47:51.640726 (+901378us) catalog_manager.cc:2147] Created new table in HMS catalog
0620 14:47:51.662583 (+ 21857us) catalog_manager.cc:2181] Wrote table and tablets to system table
0620 14:47:51.662698 (+ 115us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0620 14:47:51.662778 (+ 80us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 14:47:51.642566 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 14:47:51.642671 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0620 14:47:51.642678 (+ 7us) write_op.cc:435] Acquired schema lock
0620 14:47:51.642680 (+ 2us) tablet.cc:660] Decoding operations
0620 14:47:51.642765 (+ 85us) write_op.cc:620] Acquiring the partition lock for write op
0620 14:47:51.642776 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0620 14:47:51.642780 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0620 14:47:51.642864 (+ 84us) tablet.cc:699] Row locks acquired
0620 14:47:51.642867 (+ 3us) write_op.cc:260] PREPARE: finished
0620 14:47:51.642902 (+ 35us) write_op.cc:270] Start()
0620 14:47:51.642936 (+ 34us) write_op.cc:276] Timestamp: P: 1781966871642863 usec, L: 0
0620 14:47:51.642940 (+ 4us) op_driver.cc:331] REPLICATION: starting
0620 14:47:51.643105 (+ 165us) log.cc:842] Serialized 432 byte log entry
0620 14:47:51.660672 (+ 17567us) op_driver.cc:444] REPLICATION: finished
0620 14:47:51.661551 (+ 879us) write_op.cc:301] APPLY: starting
0620 14:47:51.661564 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
0620 14:47:51.661602 (+ 38us) tablet.cc:1368] finished BulkCheckPresence
0620 14:47:51.661634 (+ 32us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 14:47:51.661726 (+ 92us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 14:47:51.661751 (+ 25us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0620 14:47:51.661757 (+ 6us) write_op.cc:312] APPLY: finished
0620 14:47:51.661811 (+ 54us) log.cc:842] Serialized 28 byte log entry
0620 14:47:51.661861 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0620 14:47:51.661876 (+ 15us) write_op.cc:454] Released schema lock
0620 14:47:51.661882 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0620 14:47:51.661926 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0620 14:47:51.661930 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":823472,"Hive Metastore.run_cpu_time_us":343,"Hive Metastore.run_wall_time_us":77712,"child_traces":[["op",{"apply.queue_time_us":841,"apply.run_cpu_time_us":418,"apply.run_wall_time_us":418,"num_ops":2,"prepare.queue_time_us":1100,"prepare.run_cpu_time_us":617,"prepare.run_wall_time_us":1558,"replication_time_us":17711}]]}
I20260620 14:47:51.663760 8323 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59860:
table { table_name: "default.Table_7f82e63c368b415ca9ea3cd201986de1" } modify_external_catalogs: true
I20260620 14:47:51.663996 8323 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59860:
table { table_name: "default.Table_7f82e63c368b415ca9ea3cd201986de1" } modify_external_catalogs: true
I20260620 14:47:51.664188 8913 tablet_service.cc:1467] Processing CreateTablet for tablet 5f5a2717f7b243dea7faea56d5688ade (DEFAULT_TABLE table=default.table_1ea7c21a49a443c29bd5578c5950c27f [id=bfa17da52a874fa1b587ad18d04cd740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:51.664654 8913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f5a2717f7b243dea7faea56d5688ade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:51.665087 8325 catalog_manager.cc:5495] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c99207e35f8463292d71c371c9546b4 (127.7.222.195). New cstate: current_term: 1 leader_uuid: "6c99207e35f8463292d71c371c9546b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } health_report { overall_health: HEALTHY } } }
I20260620 14:47:51.670882 8642 tablet_service.cc:1467] Processing CreateTablet for tablet 5f5a2717f7b243dea7faea56d5688ade (DEFAULT_TABLE table=default.table_1ea7c21a49a443c29bd5578c5950c27f [id=bfa17da52a874fa1b587ad18d04cd740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:51.671373 8642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f5a2717f7b243dea7faea56d5688ade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:51.672307 9264 ts_tablet_manager.cc:1918] T 79da710506b745fb8e807b52a9dc54ab P 36236dd5bd604ba2819038e525a3790c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 14:47:51.672446 9264 log.cc:1196] T 79da710506b745fb8e807b52a9dc54ab P 36236dd5bd604ba2819038e525a3790c: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal/wals/79da710506b745fb8e807b52a9dc54ab
I20260620 14:47:51.672852 9264 ts_tablet_manager.cc:1939] T 79da710506b745fb8e807b52a9dc54ab P 36236dd5bd604ba2819038e525a3790c: Deleting consensus metadata
I20260620 14:47:51.673465 9152 tablet_bootstrap.cc:492] T 493a30104eab4762a3f4ffae3491765e P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:51.673614 9152 ts_tablet_manager.cc:1397] T 493a30104eab4762a3f4ffae3491765e P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.009s
I20260620 14:47:51.674700 9152 raft_consensus.cc:348] T 493a30104eab4762a3f4ffae3491765e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.674962 9152 raft_consensus.cc:374] T 493a30104eab4762a3f4ffae3491765e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:51.675058 9152 raft_consensus.cc:729] T 493a30104eab4762a3f4ffae3491765e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:51.675333 9152 consensus_queue.cc:260] T 493a30104eab4762a3f4ffae3491765e P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.677331 8318 catalog_manager.cc:4841] TS 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): tablet 79da710506b745fb8e807b52a9dc54ab (table default.table_c4d3487a7a79427b9d03ce0524ea33a8 [id=c514aca79062490a8b6a18021b07b2ff]) successfully deleted
I20260620 14:47:51.678833 9054 consensus_queue.cc:1035] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:51.676477 8780 tablet_service.cc:1467] Processing CreateTablet for tablet 5f5a2717f7b243dea7faea56d5688ade (DEFAULT_TABLE table=default.table_1ea7c21a49a443c29bd5578c5950c27f [id=bfa17da52a874fa1b587ad18d04cd740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:51.679453 8780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f5a2717f7b243dea7faea56d5688ade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:51.681496 9152 ts_tablet_manager.cc:1428] T 493a30104eab4762a3f4ffae3491765e P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260620 14:47:51.682060 9054 consensus_queue.cc:1035] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:51.690083 9152 tablet_bootstrap.cc:492] T 5f5a2717f7b243dea7faea56d5688ade P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:51.691710 9152 tablet_bootstrap.cc:654] T 5f5a2717f7b243dea7faea56d5688ade P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:51.693869 8325 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59860:
table { table_name: "default.Table_de1c78a84d1349dea4d9e9d032a258be" } modify_external_catalogs: true
I20260620 14:47:51.694134 8325 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59860:
table { table_name: "default.Table_de1c78a84d1349dea4d9e9d032a258be" } modify_external_catalogs: true
I20260620 14:47:51.708443 8912 tablet_service.cc:1467] Processing CreateTablet for tablet 493a30104eab4762a3f4ffae3491765e (DEFAULT_TABLE table=default.table_fdbead99862d49af98df44683e830bf5 [id=85b633c4801d49bd9ad9b944b178e683]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:51.709034 8912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 493a30104eab4762a3f4ffae3491765e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:51.728593 8780 tablet_service.cc:1467] Processing CreateTablet for tablet 753328bb98be4189abdbf6d60ef95fc9 (DEFAULT_TABLE table=default.table_98318448fcf3484cb76812dad2975098 [id=862dd3cee25c40eead9feb394a8b58b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:51.728585 8915 tablet_service.cc:1467] Processing CreateTablet for tablet eb6d101c1a5444cabf7c966c7ac7134e (DEFAULT_TABLE table=default.table_c4d3487a7a79427b9d03ce0524ea33a8 [id=c514aca79062490a8b6a18021b07b2ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:51.729087 8915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb6d101c1a5444cabf7c966c7ac7134e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:51.729094 8780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 753328bb98be4189abdbf6d60ef95fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:51.731628 9054 consensus_queue.cc:1035] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:51.728587 8779 tablet_service.cc:1467] Processing CreateTablet for tablet eb6d101c1a5444cabf7c966c7ac7134e (DEFAULT_TABLE table=default.table_c4d3487a7a79427b9d03ce0524ea33a8 [id=c514aca79062490a8b6a18021b07b2ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:51.733314 8779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb6d101c1a5444cabf7c966c7ac7134e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:51.739190 8640 tablet_service.cc:1467] Processing CreateTablet for tablet eb6d101c1a5444cabf7c966c7ac7134e (DEFAULT_TABLE table=default.table_c4d3487a7a79427b9d03ce0524ea33a8 [id=c514aca79062490a8b6a18021b07b2ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:51.739964 8640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb6d101c1a5444cabf7c966c7ac7134e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:51.741400 8913 tablet_service.cc:1467] Processing CreateTablet for tablet 753328bb98be4189abdbf6d60ef95fc9 (DEFAULT_TABLE table=default.table_98318448fcf3484cb76812dad2975098 [id=862dd3cee25c40eead9feb394a8b58b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:51.742134 8913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 753328bb98be4189abdbf6d60ef95fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:51.751353 8642 tablet_service.cc:1467] Processing CreateTablet for tablet 753328bb98be4189abdbf6d60ef95fc9 (DEFAULT_TABLE table=default.table_98318448fcf3484cb76812dad2975098 [id=862dd3cee25c40eead9feb394a8b58b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:51.751982 8642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 753328bb98be4189abdbf6d60ef95fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:51.770421 9265 ts_tablet_manager.cc:1905] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:51.776834 9266 tablet_replica.cc:330] T 79da710506b745fb8e807b52a9dc54ab P 6c99207e35f8463292d71c371c9546b4: stopping tablet replica
I20260620 14:47:51.777156 9266 raft_consensus.cc:2229] T 79da710506b745fb8e807b52a9dc54ab P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:51.777457 9266 raft_consensus.cc:2258] T 79da710506b745fb8e807b52a9dc54ab P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:51.778056 9266 ts_tablet_manager.cc:1905] T 79da710506b745fb8e807b52a9dc54ab P 6c99207e35f8463292d71c371c9546b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:51.789844 9258 tablet_bootstrap.cc:492] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:51.790017 9258 ts_tablet_manager.cc:1397] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.221s user 0.009s sys 0.000s
I20260620 14:47:51.790751 9258 raft_consensus.cc:348] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.790997 9258 raft_consensus.cc:374] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:51.791091 9258 raft_consensus.cc:729] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:51.791288 9258 consensus_queue.cc:260] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.791801 9258 ts_tablet_manager.cc:1428] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 14:47:51.792091 9258 tablet_bootstrap.cc:492] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:51.794160 9258 tablet_bootstrap.cc:654] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:51.795444 9256 tablet_bootstrap.cc:492] T 8caaa1b5e0384a6ab49b9fd7162896c8 P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:51.797209 9256 tablet_bootstrap.cc:654] T 8caaa1b5e0384a6ab49b9fd7162896c8 P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:51.806301 9256 tablet_bootstrap.cc:492] T 8caaa1b5e0384a6ab49b9fd7162896c8 P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:51.806460 9256 ts_tablet_manager.cc:1397] T 8caaa1b5e0384a6ab49b9fd7162896c8 P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260620 14:47:51.807253 9256 raft_consensus.cc:348] T 8caaa1b5e0384a6ab49b9fd7162896c8 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.807502 9256 raft_consensus.cc:374] T 8caaa1b5e0384a6ab49b9fd7162896c8 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:51.807593 9256 raft_consensus.cc:729] T 8caaa1b5e0384a6ab49b9fd7162896c8 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:51.813723 9152 tablet_bootstrap.cc:492] T 5f5a2717f7b243dea7faea56d5688ade P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:51.814303 9152 ts_tablet_manager.cc:1397] T 5f5a2717f7b243dea7faea56d5688ade P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.124s user 0.056s sys 0.028s
I20260620 14:47:51.815160 9256 consensus_queue.cc:260] T 8caaa1b5e0384a6ab49b9fd7162896c8 P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.815230 9152 raft_consensus.cc:348] T 5f5a2717f7b243dea7faea56d5688ade P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.815478 9152 raft_consensus.cc:374] T 5f5a2717f7b243dea7faea56d5688ade P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:51.815559 9152 raft_consensus.cc:729] T 5f5a2717f7b243dea7faea56d5688ade P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:51.815737 9258 tablet_bootstrap.cc:492] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:51.815892 9258 ts_tablet_manager.cc:1397] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.006s
I20260620 14:47:51.815778 9152 consensus_queue.cc:260] T 5f5a2717f7b243dea7faea56d5688ade P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.816299 9152 ts_tablet_manager.cc:1428] T 5f5a2717f7b243dea7faea56d5688ade P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 14:47:51.816601 9152 tablet_bootstrap.cc:492] T eb6d101c1a5444cabf7c966c7ac7134e P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:51.816606 9258 raft_consensus.cc:348] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.816839 9258 raft_consensus.cc:374] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:51.816910 9258 raft_consensus.cc:729] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:51.817180 9258 consensus_queue.cc:260] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.817910 9258 ts_tablet_manager.cc:1428] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 14:47:51.818195 9258 tablet_bootstrap.cc:492] T eb6d101c1a5444cabf7c966c7ac7134e P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:51.818384 9152 tablet_bootstrap.cc:654] T eb6d101c1a5444cabf7c966c7ac7134e P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:51.819360 9256 ts_tablet_manager.cc:1428] T 8caaa1b5e0384a6ab49b9fd7162896c8 P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20260620 14:47:51.819648 9265 ts_tablet_manager.cc:1918] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:51.819790 9265 log.cc:1196] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/wal/wals/79da710506b745fb8e807b52a9dc54ab
I20260620 14:47:51.819805 9258 tablet_bootstrap.cc:654] T eb6d101c1a5444cabf7c966c7ac7134e P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:51.820276 9265 ts_tablet_manager.cc:1939] T 79da710506b745fb8e807b52a9dc54ab P c0e6c57ab91e42bf9be3739c816916c0: Deleting consensus metadata
I20260620 14:47:51.821590 8316 catalog_manager.cc:4841] TS c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821): tablet 79da710506b745fb8e807b52a9dc54ab (table default.table_c4d3487a7a79427b9d03ce0524ea33a8 [id=c514aca79062490a8b6a18021b07b2ff]) successfully deleted
I20260620 14:47:51.825017 9266 ts_tablet_manager.cc:1918] T 79da710506b745fb8e807b52a9dc54ab P 6c99207e35f8463292d71c371c9546b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 14:47:51.825177 9266 log.cc:1196] T 79da710506b745fb8e807b52a9dc54ab P 6c99207e35f8463292d71c371c9546b4: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal/wals/79da710506b745fb8e807b52a9dc54ab
I20260620 14:47:51.825605 9266 ts_tablet_manager.cc:1939] T 79da710506b745fb8e807b52a9dc54ab P 6c99207e35f8463292d71c371c9546b4: Deleting consensus metadata
I20260620 14:47:51.826622 8316 catalog_manager.cc:4841] TS 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): tablet 79da710506b745fb8e807b52a9dc54ab (table default.table_c4d3487a7a79427b9d03ce0524ea33a8 [id=c514aca79062490a8b6a18021b07b2ff]) successfully deleted
I20260620 14:47:51.826900 9256 tablet_bootstrap.cc:492] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:51.828647 9256 tablet_bootstrap.cc:654] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:51.838897 9152 tablet_bootstrap.cc:492] T eb6d101c1a5444cabf7c966c7ac7134e P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:51.839074 9152 ts_tablet_manager.cc:1397] T eb6d101c1a5444cabf7c966c7ac7134e P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.000s
I20260620 14:47:51.839231 9258 tablet_bootstrap.cc:492] T eb6d101c1a5444cabf7c966c7ac7134e P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:51.839385 9258 ts_tablet_manager.cc:1397] T eb6d101c1a5444cabf7c966c7ac7134e P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.002s
I20260620 14:47:51.839944 9152 raft_consensus.cc:348] T eb6d101c1a5444cabf7c966c7ac7134e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.840189 9152 raft_consensus.cc:374] T eb6d101c1a5444cabf7c966c7ac7134e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:51.840070 9258 raft_consensus.cc:348] T eb6d101c1a5444cabf7c966c7ac7134e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.840318 9258 raft_consensus.cc:374] T eb6d101c1a5444cabf7c966c7ac7134e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:51.840281 9152 raft_consensus.cc:729] T eb6d101c1a5444cabf7c966c7ac7134e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:51.840408 9258 raft_consensus.cc:729] T eb6d101c1a5444cabf7c966c7ac7134e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:51.840586 9152 consensus_queue.cc:260] T eb6d101c1a5444cabf7c966c7ac7134e P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.840660 9258 consensus_queue.cc:260] T eb6d101c1a5444cabf7c966c7ac7134e P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.841225 9152 ts_tablet_manager.cc:1428] T eb6d101c1a5444cabf7c966c7ac7134e P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260620 14:47:51.841725 9152 tablet_bootstrap.cc:492] T 753328bb98be4189abdbf6d60ef95fc9 P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:51.842008 9258 ts_tablet_manager.cc:1428] T eb6d101c1a5444cabf7c966c7ac7134e P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260620 14:47:51.842278 9258 tablet_bootstrap.cc:492] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:51.843474 9152 tablet_bootstrap.cc:654] T 753328bb98be4189abdbf6d60ef95fc9 P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:51.844300 9258 tablet_bootstrap.cc:654] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:51.874408 9258 tablet_bootstrap.cc:492] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:51.874619 9258 ts_tablet_manager.cc:1397] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.032s user 0.006s sys 0.000s
I20260620 14:47:51.875357 9258 raft_consensus.cc:348] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.875602 9258 raft_consensus.cc:374] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:51.875680 9258 raft_consensus.cc:729] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:51.875939 9258 consensus_queue.cc:260] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.877460 9228 raft_consensus.cc:482] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:51.877651 9228 raft_consensus.cc:504] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.878508 9228 leader_election.cc:288] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:51.878960 8800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f5a2717f7b243dea7faea56d5688ade" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:47:51.879247 8800 raft_consensus.cc:2454] T 5f5a2717f7b243dea7faea56d5688ade P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:51.879792 8871 leader_election.cc:302] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4; no voters:
I20260620 14:47:51.880340 9258 ts_tablet_manager.cc:1428] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260620 14:47:51.880363 9228 raft_consensus.cc:2781] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:51.880504 9228 raft_consensus.cc:482] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:51.880595 9228 raft_consensus.cc:3037] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:51.880733 9258 tablet_bootstrap.cc:492] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:51.882395 8661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f5a2717f7b243dea7faea56d5688ade" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
W20260620 14:47:51.883092 8869 leader_election.cc:341] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821): Illegal state: must be running to vote when last-logged opid is not known
I20260620 14:47:51.883334 9258 tablet_bootstrap.cc:654] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:51.883490 9228 raft_consensus.cc:504] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.884685 8661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f5a2717f7b243dea7faea56d5688ade" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
W20260620 14:47:51.885324 8869 leader_election.cc:341] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821): Illegal state: must be running to vote when last-logged opid is not known
I20260620 14:47:51.887110 8800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f5a2717f7b243dea7faea56d5688ade" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:47:51.887348 8800 raft_consensus.cc:3037] T 5f5a2717f7b243dea7faea56d5688ade P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:51.890173 8800 raft_consensus.cc:2454] T 5f5a2717f7b243dea7faea56d5688ade P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:51.890796 8871 leader_election.cc:302] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4; no voters: c0e6c57ab91e42bf9be3739c816916c0
I20260620 14:47:51.891119 9062 raft_consensus.cc:2781] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:51.891276 9062 raft_consensus.cc:686] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Becoming Leader. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Running, Role: LEADER
I20260620 14:47:51.891512 9062 consensus_queue.cc:237] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.893922 9228 leader_election.cc:288] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Requested vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:51.900341 9152 tablet_bootstrap.cc:492] T 753328bb98be4189abdbf6d60ef95fc9 P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:51.900542 9152 ts_tablet_manager.cc:1397] T 753328bb98be4189abdbf6d60ef95fc9 P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.059s user 0.010s sys 0.018s
I20260620 14:47:51.901572 9258 tablet_bootstrap.cc:492] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:51.901415 9152 raft_consensus.cc:348] T 753328bb98be4189abdbf6d60ef95fc9 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.901675 9152 raft_consensus.cc:374] T 753328bb98be4189abdbf6d60ef95fc9 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:51.901722 9258 ts_tablet_manager.cc:1397] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.005s
I20260620 14:47:51.901762 9152 raft_consensus.cc:729] T 753328bb98be4189abdbf6d60ef95fc9 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:51.902062 9152 consensus_queue.cc:260] T 753328bb98be4189abdbf6d60ef95fc9 P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.902465 9258 raft_consensus.cc:348] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.902637 9152 ts_tablet_manager.cc:1428] T 753328bb98be4189abdbf6d60ef95fc9 P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 14:47:51.902688 9258 raft_consensus.cc:374] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:51.903285 9258 raft_consensus.cc:729] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:51.903532 9258 consensus_queue.cc:260] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.907236 9258 ts_tablet_manager.cc:1428] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260620 14:47:51.909834 9256 tablet_bootstrap.cc:492] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:51.910396 9256 ts_tablet_manager.cc:1397] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.087s user 0.008s sys 0.038s
I20260620 14:47:51.911119 9256 raft_consensus.cc:348] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.911352 9256 raft_consensus.cc:374] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:51.911428 9256 raft_consensus.cc:729] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:51.911648 9256 consensus_queue.cc:260] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.912195 9256 ts_tablet_manager.cc:1428] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 14:47:51.917598 9256 tablet_bootstrap.cc:492] T 5f5a2717f7b243dea7faea56d5688ade P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:51.919420 9256 tablet_bootstrap.cc:654] T 5f5a2717f7b243dea7faea56d5688ade P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:51.939812 9256 tablet_bootstrap.cc:492] T 5f5a2717f7b243dea7faea56d5688ade P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:51.940012 9256 ts_tablet_manager.cc:1397] T 5f5a2717f7b243dea7faea56d5688ade P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.005s
I20260620 14:47:51.941283 9256 raft_consensus.cc:348] T 5f5a2717f7b243dea7faea56d5688ade P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.941550 9256 raft_consensus.cc:374] T 5f5a2717f7b243dea7faea56d5688ade P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:51.941642 9256 raft_consensus.cc:729] T 5f5a2717f7b243dea7faea56d5688ade P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:51.941888 9256 consensus_queue.cc:260] T 5f5a2717f7b243dea7faea56d5688ade P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.942451 9256 ts_tablet_manager.cc:1428] T 5f5a2717f7b243dea7faea56d5688ade P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260620 14:47:51.942760 9256 tablet_bootstrap.cc:492] T eb6d101c1a5444cabf7c966c7ac7134e P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:51.944496 9256 tablet_bootstrap.cc:654] T eb6d101c1a5444cabf7c966c7ac7134e P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:51.966833 9256 tablet_bootstrap.cc:492] T eb6d101c1a5444cabf7c966c7ac7134e P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:51.967041 9256 ts_tablet_manager.cc:1397] T eb6d101c1a5444cabf7c966c7ac7134e P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.002s
I20260620 14:47:51.967880 9256 raft_consensus.cc:348] T eb6d101c1a5444cabf7c966c7ac7134e P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.968211 9256 raft_consensus.cc:374] T eb6d101c1a5444cabf7c966c7ac7134e P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:51.968312 9256 raft_consensus.cc:729] T eb6d101c1a5444cabf7c966c7ac7134e P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:51.968663 9256 consensus_queue.cc:260] T eb6d101c1a5444cabf7c966c7ac7134e P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.973006 9256 ts_tablet_manager.cc:1428] T eb6d101c1a5444cabf7c966c7ac7134e P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260620 14:47:51.973570 9062 raft_consensus.cc:482] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:51.973728 9062 raft_consensus.cc:504] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.974431 9062 leader_election.cc:288] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:51.975124 8661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8caaa1b5e0384a6ab49b9fd7162896c8" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:47:51.975400 8661 raft_consensus.cc:2454] T 8caaa1b5e0384a6ab49b9fd7162896c8 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:51.975978 8869 leader_election.cc:302] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:51.976248 9062 raft_consensus.cc:2781] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:51.976361 9062 raft_consensus.cc:482] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:51.976459 9062 raft_consensus.cc:3037] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:51.977208 9256 tablet_bootstrap.cc:492] T 753328bb98be4189abdbf6d60ef95fc9 P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:51.976197 8800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8caaa1b5e0384a6ab49b9fd7162896c8" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:47:51.977430 8800 raft_consensus.cc:2454] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:51.978963 9256 tablet_bootstrap.cc:654] T 753328bb98be4189abdbf6d60ef95fc9 P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:51.979723 9062 raft_consensus.cc:504] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.980643 8661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8caaa1b5e0384a6ab49b9fd7162896c8" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:47:51.980888 8661 raft_consensus.cc:3037] T 8caaa1b5e0384a6ab49b9fd7162896c8 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:51.983654 8661 raft_consensus.cc:2454] T 8caaa1b5e0384a6ab49b9fd7162896c8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:51.984055 8869 leader_election.cc:302] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:51.984345 9228 raft_consensus.cc:2781] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:51.984467 9228 raft_consensus.cc:686] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Becoming Leader. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Running, Role: LEADER
I20260620 14:47:51.984720 9228 consensus_queue.cc:237] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.987120 9062 leader_election.cc:288] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Requested vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:51.987720 8800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8caaa1b5e0384a6ab49b9fd7162896c8" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:47:51.987953 8800 raft_consensus.cc:3037] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:51.990715 8800 raft_consensus.cc:2454] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:51.991235 9256 tablet_bootstrap.cc:492] T 753328bb98be4189abdbf6d60ef95fc9 P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:51.991382 9256 ts_tablet_manager.cc:1397] T 753328bb98be4189abdbf6d60ef95fc9 P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260620 14:47:51.992131 9256 raft_consensus.cc:348] T 753328bb98be4189abdbf6d60ef95fc9 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.992360 9256 raft_consensus.cc:374] T 753328bb98be4189abdbf6d60ef95fc9 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:51.992466 9256 raft_consensus.cc:729] T 753328bb98be4189abdbf6d60ef95fc9 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:51.992678 9256 consensus_queue.cc:260] T 753328bb98be4189abdbf6d60ef95fc9 P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:51.997028 9256 ts_tablet_manager.cc:1428] T 753328bb98be4189abdbf6d60ef95fc9 P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260620 14:47:52.015421 9069 raft_consensus.cc:482] T eb6d101c1a5444cabf7c966c7ac7134e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:52.015657 9069 raft_consensus.cc:504] T eb6d101c1a5444cabf7c966c7ac7134e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:52.016386 9069 leader_election.cc:288] T eb6d101c1a5444cabf7c966c7ac7134e P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:47:52.017217 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb6d101c1a5444cabf7c966c7ac7134e" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4" is_pre_election: true
I20260620 14:47:52.017231 8661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb6d101c1a5444cabf7c966c7ac7134e" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:47:52.017477 8935 raft_consensus.cc:2454] T eb6d101c1a5444cabf7c966c7ac7134e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 0.
I20260620 14:47:52.017485 8661 raft_consensus.cc:2454] T eb6d101c1a5444cabf7c966c7ac7134e P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 0.
I20260620 14:47:52.017944 8733 leader_election.cc:302] T eb6d101c1a5444cabf7c966c7ac7134e P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4; no voters:
I20260620 14:47:52.018402 9069 raft_consensus.cc:2781] T eb6d101c1a5444cabf7c966c7ac7134e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:52.018538 9069 raft_consensus.cc:482] T eb6d101c1a5444cabf7c966c7ac7134e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:52.018682 9069 raft_consensus.cc:3037] T eb6d101c1a5444cabf7c966c7ac7134e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:52.022099 9069 raft_consensus.cc:504] T eb6d101c1a5444cabf7c966c7ac7134e P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:52.023166 8661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb6d101c1a5444cabf7c966c7ac7134e" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:47:52.023377 8661 raft_consensus.cc:3037] T eb6d101c1a5444cabf7c966c7ac7134e P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:52.026157 8661 raft_consensus.cc:2454] T eb6d101c1a5444cabf7c966c7ac7134e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 1.
I20260620 14:47:52.026605 8733 leader_election.cc:302] T eb6d101c1a5444cabf7c966c7ac7134e P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:52.026944 9273 raft_consensus.cc:2781] T eb6d101c1a5444cabf7c966c7ac7134e P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:52.027113 9273 raft_consensus.cc:686] T eb6d101c1a5444cabf7c966c7ac7134e P 36236dd5bd604ba2819038e525a3790c [term 1 LEADER]: Becoming Leader. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Running, Role: LEADER
I20260620 14:47:52.027438 9273 consensus_queue.cc:237] T eb6d101c1a5444cabf7c966c7ac7134e P 36236dd5bd604ba2819038e525a3790c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:52.027647 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb6d101c1a5444cabf7c966c7ac7134e" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4"
I20260620 14:47:52.027859 8935 raft_consensus.cc:3037] T eb6d101c1a5444cabf7c966c7ac7134e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:52.030654 8935 raft_consensus.cc:2454] T eb6d101c1a5444cabf7c966c7ac7134e P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 1.
I20260620 14:47:52.031193 9069 leader_election.cc:288] T eb6d101c1a5444cabf7c966c7ac7134e P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 election: Requested vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:47:52.067116 9228 raft_consensus.cc:482] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:52.067327 9228 raft_consensus.cc:504] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:52.068007 9228 leader_election.cc:288] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:52.068702 8661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "753328bb98be4189abdbf6d60ef95fc9" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:47:52.068991 8661 raft_consensus.cc:2454] T 753328bb98be4189abdbf6d60ef95fc9 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:52.069721 8800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "753328bb98be4189abdbf6d60ef95fc9" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:47:52.069983 8800 raft_consensus.cc:2454] T 753328bb98be4189abdbf6d60ef95fc9 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:52.070302 8869 leader_election.cc:302] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:52.070966 9228 raft_consensus.cc:2781] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:52.071066 9228 raft_consensus.cc:482] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:52.071177 9228 raft_consensus.cc:3037] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:52.074383 9228 raft_consensus.cc:504] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:52.075477 8661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "753328bb98be4189abdbf6d60ef95fc9" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:47:52.075712 8661 raft_consensus.cc:3037] T 753328bb98be4189abdbf6d60ef95fc9 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:52.088877 8661 raft_consensus.cc:2454] T 753328bb98be4189abdbf6d60ef95fc9 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:52.089499 8869 leader_election.cc:302] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:52.089848 9062 raft_consensus.cc:2781] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:52.090010 9062 raft_consensus.cc:686] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Becoming Leader. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Running, Role: LEADER
I20260620 14:47:52.090293 9062 consensus_queue.cc:237] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:52.096354 8800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "753328bb98be4189abdbf6d60ef95fc9" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:47:52.096594 8800 raft_consensus.cc:3037] T 753328bb98be4189abdbf6d60ef95fc9 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:52.100139 8800 raft_consensus.cc:2454] T 753328bb98be4189abdbf6d60ef95fc9 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:52.100656 9228 leader_election.cc:288] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Requested vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:52.127727 9102 raft_consensus.cc:482] T 5f5a2717f7b243dea7faea56d5688ade P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:52.127956 9102 raft_consensus.cc:504] T 5f5a2717f7b243dea7faea56d5688ade P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:52.128647 9102 leader_election.cc:288] T 5f5a2717f7b243dea7faea56d5688ade P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:47:52.129397 8800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f5a2717f7b243dea7faea56d5688ade" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:47:52.129685 8800 raft_consensus.cc:2379] T 5f5a2717f7b243dea7faea56d5688ade P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0e6c57ab91e42bf9be3739c816916c0 in current term 1: Already voted for candidate 6c99207e35f8463292d71c371c9546b4 in this term.
I20260620 14:47:52.130398 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f5a2717f7b243dea7faea56d5688ade" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4" is_pre_election: true
I20260620 14:47:52.131042 8596 leader_election.cc:302] T 5f5a2717f7b243dea7faea56d5688ade P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:47:52.131502 9102 raft_consensus.cc:3037] T 5f5a2717f7b243dea7faea56d5688ade P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:52.134840 9102 raft_consensus.cc:2726] T 5f5a2717f7b243dea7faea56d5688ade P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 14:47:52.231009 9290 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd308569015348a7a19ba4a560de6d52)
I20260620 14:47:52.231349 9290 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:52.238857 8341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" candidate_term: 2 candidate_status { last_received { term: 1 index: 50 } } ignore_live_leader: false dest_uuid: "dd308569015348a7a19ba4a560de6d52" is_pre_election: true
I20260620 14:47:52.240429 9290 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
I20260620 14:47:52.241605 9291 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd308569015348a7a19ba4a560de6d52)
I20260620 14:47:52.242208 9291 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:52.243376 9291 leader_election.cc:288] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209)
I20260620 14:47:52.244366 8341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "61512e6d316d4d3a998e52511a0bba7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 50 } } ignore_live_leader: false dest_uuid: "dd308569015348a7a19ba4a560de6d52" is_pre_election: true
I20260620 14:47:52.268594 8480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" candidate_term: 2 candidate_status { last_received { term: 1 index: 50 } } ignore_live_leader: false dest_uuid: "61512e6d316d4d3a998e52511a0bba7a" is_pre_election: true
I20260620 14:47:52.268464 9179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "61512e6d316d4d3a998e52511a0bba7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 50 } } ignore_live_leader: false dest_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" is_pre_election: true
I20260620 14:47:52.268901 8480 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa9dcf251944f7d97f4ed7f3d83af44 in term 1.
I20260620 14:47:52.269495 9140 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61512e6d316d4d3a998e52511a0bba7a, caa9dcf251944f7d97f4ed7f3d83af44; no voters: dd308569015348a7a19ba4a560de6d52
I20260620 14:47:52.269635 8457 leader_election.cc:302] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61512e6d316d4d3a998e52511a0bba7a; no voters: caa9dcf251944f7d97f4ed7f3d83af44, dd308569015348a7a19ba4a560de6d52
I20260620 14:47:52.269958 9290 raft_consensus.cc:2781] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260620 14:47:52.270105 9290 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dd308569015348a7a19ba4a560de6d52)
I20260620 14:47:52.270201 9290 raft_consensus.cc:3037] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 1 FOLLOWER]: Advancing to term 2
I20260620 14:47:52.270215 9291 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:47:52.275537 9290 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:52.277036 8341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" candidate_term: 2 candidate_status { last_received { term: 1 index: 50 } } ignore_live_leader: false dest_uuid: "dd308569015348a7a19ba4a560de6d52"
I20260620 14:47:52.277908 9290 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 2 election: Requested vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
I20260620 14:47:52.279053 8480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" candidate_term: 2 candidate_status { last_received { term: 1 index: 50 } } ignore_live_leader: false dest_uuid: "61512e6d316d4d3a998e52511a0bba7a"
I20260620 14:47:52.279292 8480 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 1 FOLLOWER]: Advancing to term 2
I20260620 14:47:52.282294 8480 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa9dcf251944f7d97f4ed7f3d83af44 in term 2.
I20260620 14:47:52.282998 9140 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61512e6d316d4d3a998e52511a0bba7a, caa9dcf251944f7d97f4ed7f3d83af44; no voters: dd308569015348a7a19ba4a560de6d52
I20260620 14:47:52.283370 9290 raft_consensus.cc:2781] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 14:47:52.286993 8480 raft_consensus.cc:1226] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 2 FOLLOWER]: Rejecting Update request from peer dd308569015348a7a19ba4a560de6d52 for earlier term 1. Current term is 2. Ops: []
I20260620 14:47:52.287716 9255 consensus_queue.cc:1046] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 }, Status: INVALID_TERM, Last received: 1.50, Next index: 51, Last known committed idx: 50, Time since last communication: 0.000s
I20260620 14:47:52.292215 9290 raft_consensus.cc:686] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 2 LEADER]: Becoming Leader. State: Replica: caa9dcf251944f7d97f4ed7f3d83af44, State: Running, Role: LEADER
I20260620 14:47:52.292860 9290 consensus_queue.cc:237] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 50, Committed index: 50, Last appended: 1.50, Last appended by leader: 50, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:52.294693 9296 sys_catalog.cc:455] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: SysCatalogTable state changed. Reason: New leader caa9dcf251944f7d97f4ed7f3d83af44. Latest consensus state: current_term: 2 leader_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:52.295048 9296 sys_catalog.cc:458] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: This master's current role is: LEADER
I20260620 14:47:52.295779 9298 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:47:52.300045 9298 catalog_manager.cc:669] Loaded metadata for table default.table_116796b0dc6c4dbd97c4f0c519f6d18f [id=0c4867ea1c1e45f388ccd4e2c9de093e]
I20260620 14:47:52.300629 9298 catalog_manager.cc:669] Loaded metadata for table default.table_1d0410429a7242ab85d16d800ffd0502 [id=15e21d8b3d5644f8ac2112c1dd37e7ff]
I20260620 14:47:52.301136 9298 catalog_manager.cc:669] Loaded metadata for table default.table_0eb776233cee4294b6c96ec556447663 [id=3420fc1c9c8b45f49aeaa7b4c97da51e]
I20260620 14:47:52.301872 9298 catalog_manager.cc:669] Loaded metadata for table default.table_bb493f9370e74bafae7b1e42f5c5f770 [id=6a722b39b30e45649b7b70c32c9e2260]
I20260620 14:47:52.302336 9298 catalog_manager.cc:669] Loaded metadata for table default.table_7f82e63c368b415ca9ea3cd201986de1 [id=7f9c4b4af7614d20b0e5ddfbf7d2b0f5]
I20260620 14:47:52.302802 9298 catalog_manager.cc:669] Loaded metadata for table default.table_fdbead99862d49af98df44683e830bf5 [id=85b633c4801d49bd9ad9b944b178e683]
I20260620 14:47:52.303278 9298 catalog_manager.cc:669] Loaded metadata for table default.table_98318448fcf3484cb76812dad2975098 [id=862dd3cee25c40eead9feb394a8b58b1]
I20260620 14:47:52.303751 9298 catalog_manager.cc:669] Loaded metadata for table default.table_19c624001d444b7b9939e22128c594aa [id=98d2e7b647544a97b50827a0cb2799a0]
I20260620 14:47:52.304266 9298 catalog_manager.cc:669] Loaded metadata for table default.table_0210e4215f5f4663af08e8f4da05f3b3 [id=9c1e21a6c9244efba2e86bfa28264a0d]
I20260620 14:47:52.304765 9298 catalog_manager.cc:669] Loaded metadata for table default.table_de1c78a84d1349dea4d9e9d032a258be [id=a78802b888ed44b5b439381a6890a67d]
I20260620 14:47:52.305248 9298 catalog_manager.cc:669] Loaded metadata for table default.table_1ea7c21a49a443c29bd5578c5950c27f [id=bfa17da52a874fa1b587ad18d04cd740]
I20260620 14:47:52.305712 9298 catalog_manager.cc:669] Loaded metadata for table default.table_c4d3487a7a79427b9d03ce0524ea33a8 [id=c514aca79062490a8b6a18021b07b2ff]
I20260620 14:47:52.306421 9298 catalog_manager.cc:669] Loaded metadata for table default.table_b702c9d170e842fa824a76fb4be199fb [id=c65e926af55d4fbba6c42f4d2ddbb397]
I20260620 14:47:52.306874 9298 catalog_manager.cc:669] Loaded metadata for table default.table_a800f01d336648a8b400cefc457c444d [id=ef56cde5526c4d9eacfbcd58922deed3]
I20260620 14:47:52.309526 9298 tablet_loader.cc:96] loaded metadata for tablet 1ad679f398ab41a1bc207b016648cbe8 (table default.table_19c624001d444b7b9939e22128c594aa [id=98d2e7b647544a97b50827a0cb2799a0])
I20260620 14:47:52.309970 9297 raft_consensus.cc:3032] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 14:47:52.310099 9297 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd308569015348a7a19ba4a560de6d52, State: Running, Role: LEADER
I20260620 14:47:52.310021 9298 tablet_loader.cc:96] loaded metadata for tablet 235446b4e9324eab836718837a0de8d5 (table default.table_1d0410429a7242ab85d16d800ffd0502 [id=15e21d8b3d5644f8ac2112c1dd37e7ff])
I20260620 14:47:52.310624 9298 tablet_loader.cc:96] loaded metadata for tablet 38195d2af2f243dc9f9f12a2ebb0d5eb (table default.table_7f82e63c368b415ca9ea3cd201986de1 [id=7f9c4b4af7614d20b0e5ddfbf7d2b0f5])
I20260620 14:47:52.310509 9297 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 50, Committed index: 50, Last appended: 1.50, Last appended by leader: 50, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:52.311146 9298 tablet_loader.cc:96] loaded metadata for tablet 3a85749745a7440fb637d4918de5f798 (table default.table_de1c78a84d1349dea4d9e9d032a258be [id=a78802b888ed44b5b439381a6890a67d])
I20260620 14:47:52.311148 9297 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 1 FOLLOWER]: Advancing to term 2
I20260620 14:47:52.311586 9298 tablet_loader.cc:96] loaded metadata for tablet 493a30104eab4762a3f4ffae3491765e (table default.table_fdbead99862d49af98df44683e830bf5 [id=85b633c4801d49bd9ad9b944b178e683])
I20260620 14:47:52.312486 9298 tablet_loader.cc:96] loaded metadata for tablet 5f5a2717f7b243dea7faea56d5688ade (table default.table_1ea7c21a49a443c29bd5578c5950c27f [id=bfa17da52a874fa1b587ad18d04cd740])
I20260620 14:47:52.312913 9298 tablet_loader.cc:96] loaded metadata for tablet 675413dc550f485dbef0d180ed27ff0e (table default.table_116796b0dc6c4dbd97c4f0c519f6d18f [id=0c4867ea1c1e45f388ccd4e2c9de093e])
I20260620 14:47:52.313603 9298 tablet_loader.cc:96] loaded metadata for tablet 753328bb98be4189abdbf6d60ef95fc9 (table default.table_98318448fcf3484cb76812dad2975098 [id=862dd3cee25c40eead9feb394a8b58b1])
I20260620 14:47:52.313982 9298 tablet_loader.cc:96] loaded metadata for tablet 77f744b0f04a416099d955dcba1be34a (table default.table_a800f01d336648a8b400cefc457c444d [id=ef56cde5526c4d9eacfbcd58922deed3])
I20260620 14:47:52.314730 9298 tablet_loader.cc:96] loaded metadata for tablet 8caaa1b5e0384a6ab49b9fd7162896c8 (table default.table_bb493f9370e74bafae7b1e42f5c5f770 [id=6a722b39b30e45649b7b70c32c9e2260])
I20260620 14:47:52.315176 9298 tablet_loader.cc:96] loaded metadata for tablet a4552c4e15464f21a10b6c2d83f7ead8 (table default.table_0210e4215f5f4663af08e8f4da05f3b3 [id=9c1e21a6c9244efba2e86bfa28264a0d])
I20260620 14:47:52.315820 9298 tablet_loader.cc:96] loaded metadata for tablet bd541e6a431348c7a506611681730fc5 (table default.table_b702c9d170e842fa824a76fb4be199fb [id=c65e926af55d4fbba6c42f4d2ddbb397])
I20260620 14:47:52.316449 9298 tablet_loader.cc:96] loaded metadata for tablet c33a5b17df824c0ab066dee1fa610906 (table default.table_0eb776233cee4294b6c96ec556447663 [id=3420fc1c9c8b45f49aeaa7b4c97da51e])
I20260620 14:47:52.316903 9298 tablet_loader.cc:96] loaded metadata for tablet eb6d101c1a5444cabf7c966c7ac7134e (table default.table_c4d3487a7a79427b9d03ce0524ea33a8 [id=c514aca79062490a8b6a18021b07b2ff])
I20260620 14:47:52.317356 9298 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:47:52.318958 9298 catalog_manager.cc:1259] Loaded cluster ID: 700994c053c643c896af12c77a108604
I20260620 14:47:52.319083 9298 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:47:52.321745 9298 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:47:52.323578 9298 catalog_manager.cc:5879] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Loaded TSK: 0
I20260620 14:47:52.325055 9298 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 14:47:52.326560 9298 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260620 14:47:52.328470 9298 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: 11
I20260620 14:47:52.367743 9234 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:52.367977 9234 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:52.369302 9234 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:52.369459 8800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "493a30104eab4762a3f4ffae3491765e" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:47:52.369730 8800 raft_consensus.cc:2454] T 493a30104eab4762a3f4ffae3491765e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:52.369719 8661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "493a30104eab4762a3f4ffae3491765e" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:47:52.369997 8661 raft_consensus.cc:2454] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:52.370507 8869 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:52.370787 9234 raft_consensus.cc:2781] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:52.370900 9234 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:52.371008 9234 raft_consensus.cc:3037] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:52.371834 9062 consensus_queue.cc:1035] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:52.373904 9234 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:52.375020 8661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "493a30104eab4762a3f4ffae3491765e" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:47:52.375228 8661 raft_consensus.cc:3037] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:52.378084 8661 raft_consensus.cc:2454] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:52.378727 8869 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:52.379019 9062 raft_consensus.cc:2781] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:52.379175 9062 raft_consensus.cc:686] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Becoming Leader. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Running, Role: LEADER
I20260620 14:47:52.379355 9234 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Requested vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:52.379472 9062 consensus_queue.cc:237] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:52.381167 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "493a30104eab4762a3f4ffae3491765e" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:47:52.381430 8799 raft_consensus.cc:3037] T 493a30104eab4762a3f4ffae3491765e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:52.384050 8799 raft_consensus.cc:2454] T 493a30104eab4762a3f4ffae3491765e P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:52.388149 9168 catalog_manager.cc:5495] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c99207e35f8463292d71c371c9546b4 (127.7.222.195). New cstate: current_term: 1 leader_uuid: "6c99207e35f8463292d71c371c9546b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } health_report { overall_health: HEALTHY } } }
I20260620 14:47:52.389875 8329 catalog_manager.cc:2685] deleted HMS catalog entry for table default.table_a800f01d336648a8b400cefc457c444d [id=ef56cde5526c4d9eacfbcd58922deed3]
I20260620 14:47:52.408963 8847 heartbeater.cc:503] Master 127.7.222.253:34209 was elected leader, sending a full tablet report...
W20260620 14:47:52.410979 8527 catalog_manager.cc:3810] Illegal state: an error occurred while updating the sys-catalog: replica dd308569015348a7a19ba4a560de6d52 is not leader of this config: current role FOLLOWER
W20260620 14:47:52.412180 8527 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 12 ALTER_TABLE default.table_fe5ad6a8d59b4751bcbb6e1d0d4baedb: Illegal state: an error occurred while updating the sys-catalog: replica dd308569015348a7a19ba4a560de6d52 is not leader of this config: current role FOLLOWER
I20260620 14:47:52.412215 9234 consensus_queue.cc:1035] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 14:47:52.412376 8527 hms_notification_log_listener.cc:134] Hive Metastore notification log listener poll failed: Service unavailable: lost leadership while handling Hive Metastore notification log events: an error occurred while updating the sys-catalog: replica dd308569015348a7a19ba4a560de6d52 is not leader of this config: current role FOLLOWER
I20260620 14:47:52.412595 8330 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:59860 (request call id 19) took 2724 ms. Trace:
I20260620 14:47:52.412714 8330 rpcz_store.cc:276] 0620 14:47:49.688196 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:49.818781 (+130585us) service_pool.cc:227] Handling call
0620 14:47:50.735562 (+916781us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 14:47:52.412557 (+1676995us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":6651,"Hive Metastore.run_cpu_time_us":710,"Hive Metastore.run_wall_time_us":154356}
W20260620 14:47:52.414278 8987 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.7.222.254:39515)
I20260620 14:47:52.415478 8330 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:59860 (request call id 36) took 2095 ms. Trace:
I20260620 14:47:52.415594 8330 rpcz_store.cc:276] 0620 14:47:50.319748 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:52.415105 (+2095357us) service_pool.cc:227] Handling call
0620 14:47:52.415432 (+ 327us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260620 14:47:52.422499 8987 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.7.222.254:39515)
I20260620 14:47:52.416292 8330 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:59860 (request call id 37) took 2071 ms. Trace:
I20260620 14:47:52.423286 8330 rpcz_store.cc:276] 0620 14:47:50.345260 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:52.415807 (+2070547us) service_pool.cc:227] Handling call
0620 14:47:52.416253 (+ 446us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260620 14:47:52.423957 8987 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.7.222.254:39515)
W20260620 14:47:52.424943 8331 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2d00c2dfdbfe428a8de80587e6f6e918 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:47:52.425159 8324 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:59860 (request call id 12) took 2872 ms. Trace:
I20260620 14:47:52.425289 8324 rpcz_store.cc:276] 0620 14:47:49.552586 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:49.552637 (+ 51us) service_pool.cc:227] Handling call
0620 14:47:50.735550 (+1182913us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 14:47:52.424543 (+1688993us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 14:47:52.424844 (+ 301us) catalog_manager.cc:3616] Apply alter schema
0620 14:47:52.425099 (+ 255us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":161045,"Hive Metastore.run_cpu_time_us":795,"Hive Metastore.run_wall_time_us":223674,"mutex_wait_us":119,"spinlock_wait_cycles":896}
I20260620 14:47:52.426252 8328 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:59860 (request call id 13) took 2811 ms. Trace:
I20260620 14:47:52.426393 8328 rpcz_store.cc:276] 0620 14:47:49.614695 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:49.614764 (+ 69us) service_pool.cc:227] Handling call
0620 14:47:50.735745 (+1120981us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 14:47:52.425715 (+1689970us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 14:47:52.425950 (+ 235us) catalog_manager.cc:3616] Apply alter schema
0620 14:47:52.426205 (+ 255us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":384680,"Hive Metastore.run_cpu_time_us":779,"Hive Metastore.run_wall_time_us":188356,"mutex_wait_us":38}
I20260620 14:47:52.426846 8324 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:59860 (request call id 38) took 2039 ms. Trace:
I20260620 14:47:52.427008 8328 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:59860 (request call id 39) took 1952 ms. Trace:
I20260620 14:47:52.426978 8324 rpcz_store.cc:276] 0620 14:47:50.387368 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:52.426432 (+2039064us) service_pool.cc:227] Handling call
0620 14:47:52.426798 (+ 366us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 14:47:52.427146 8328 rpcz_store.cc:276] 0620 14:47:50.474304 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:52.426635 (+1952331us) service_pool.cc:227] Handling call
0620 14:47:52.426956 (+ 321us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 14:47:52.427368 8328 master_service.cc:946] ReplaceTablet: received request to replace tablet 38195d2af2f243dc9f9f12a2ebb0d5eb from {username='slave'} at 127.0.0.1:59860
I20260620 14:47:52.427539 8324 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:59860 (request call id 40) took 1907 ms. Trace:
I20260620 14:47:52.427647 8324 rpcz_store.cc:276] 0620 14:47:50.520579 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:52.427199 (+1906620us) service_pool.cc:227] Handling call
0620 14:47:52.427503 (+ 304us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 14:47:52.427731 8328 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:59860 (request call id 41) took 1904 ms. Trace:
I20260620 14:47:52.427824 8328 rpcz_store.cc:276] 0620 14:47:50.523681 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:52.427313 (+1903632us) service_pool.cc:227] Handling call
0620 14:47:52.427674 (+ 361us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 14:47:52.428048 8324 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:59860 (request call id 42) took 1464 ms. Trace:
I20260620 14:47:52.428087 8328 master_service.cc:946] ReplaceTablet: received request to replace tablet 79da710506b745fb8e807b52a9dc54ab from {username='slave'} at 127.0.0.1:59860
I20260620 14:47:52.428154 8324 rpcz_store.cc:276] 0620 14:47:50.963342 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:52.427759 (+1464417us) service_pool.cc:227] Handling call
0620 14:47:52.427979 (+ 220us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 14:47:52.428427 8328 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:59860 (request call id 43) took 1300 ms. Trace:
I20260620 14:47:52.428540 8328 rpcz_store.cc:276] 0620 14:47:51.128307 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:52.428019 (+1299712us) service_pool.cc:227] Handling call
0620 14:47:52.428386 (+ 367us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 14:47:52.429219 8324 master_service.cc:946] ReplaceTablet: received request to replace tablet 77f744b0f04a416099d955dcba1be34a from {username='slave'} at 127.0.0.1:59860
I20260620 14:47:52.429795 8324 master_service.cc:946] ReplaceTablet: received request to replace tablet 38195d2af2f243dc9f9f12a2ebb0d5eb from {username='slave'} at 127.0.0.1:59860
I20260620 14:47:52.430238 8324 master_service.cc:946] ReplaceTablet: received request to replace tablet 235446b4e9324eab836718837a0de8d5 from {username='slave'} at 127.0.0.1:59860
W20260620 14:47:52.430390 8987 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.7.222.254:39515)
I20260620 14:47:52.431847 8324 rpcz_store.cc:275] Call kudu.master.MasterService.GetMasterRegistration from 127.0.0.1:59872 (request call id 0) took 1177 ms. Trace:
I20260620 14:47:52.431999 8324 rpcz_store.cc:276] 0620 14:47:51.254381 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:52.431004 (+1176623us) service_pool.cc:227] Handling call
0620 14:47:52.431785 (+ 781us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260620 14:47:52.434685 8327 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:59860 (request call id 22) took 2657 ms. Trace:
I20260620 14:47:52.434810 8327 rpcz_store.cc:276] 0620 14:47:49.777091 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:50.182526 (+405435us) service_pool.cc:227] Handling call
0620 14:47:50.735808 (+553282us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 14:47:52.434151 (+1698343us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 14:47:52.434384 (+ 233us) catalog_manager.cc:3616] Apply alter schema
0620 14:47:52.434648 (+ 264us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":572955,"Hive Metastore.run_cpu_time_us":773,"Hive Metastore.run_wall_time_us":73050}
W20260620 14:47:52.435693 8326 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_96a3abe199c94222aea451130599b401 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:47:52.437887 8329 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:59860 (request call id 26) took 2487 ms. Trace:
I20260620 14:47:52.438026 8329 rpcz_store.cc:276] 0620 14:47:49.950890 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:50.314398 (+363508us) service_pool.cc:227] Handling call
0620 14:47:50.739502 (+425104us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 14:47:52.437846 (+1698344us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":901072,"Hive Metastore.run_cpu_time_us":379,"Hive Metastore.run_wall_time_us":749058}
I20260620 14:47:52.457342 8480 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 2 FOLLOWER]: Refusing update from remote peer caa9dcf251944f7d97f4ed7f3d83af44: Log matching property violated. Preceding OpId in replica: term: 1 index: 50. Preceding OpId from leader: term: 2 index: 52. (index mismatch)
I20260620 14:47:52.458411 9165 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38546:
table { table_name: "default.Table_c4d3487a7a79427b9d03ce0524ea33a8" } new_table_name: "default.Table_fe5ad6a8d59b4751bcbb6e1d0d4baedb" modify_external_catalogs: true
I20260620 14:47:52.458830 9164 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38546:
name: "default.Table_105950e097bf4cbda12e7532557966b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:52.459684 9163 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38546:
name: "default.Table_8cc72697ee4f4200a5f57a19280315ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:52.460574 9162 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38546:
name: "default.Table_154fc524efb24453bdb6d735e4c741e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:52.461252 9161 master_service.cc:946] ReplaceTablet: received request to replace tablet 38195d2af2f243dc9f9f12a2ebb0d5eb from {username='slave'} at 127.0.0.1:38546
I20260620 14:47:52.461716 9160 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38546:
table { table_name: "default.Table_19c624001d444b7b9939e22128c594aa" } new_table_name: "default.Table_ed65359dea1b47aab601b55d6957c2dd" modify_external_catalogs: true
I20260620 14:47:52.462055 9167 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38546:
name: "default.Table_16339630485f49f6a8bb2b71981cdeb1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:52.465065 9296 consensus_queue.cc:1035] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 51, Last known committed idx: 50, Time since last communication: 0.000s
I20260620 14:47:52.470633 9166 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38546:
table { table_name: "default.Table_0eb776233cee4294b6c96ec556447663" } modify_external_catalogs: true
I20260620 14:47:52.470933 9166 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38546:
table { table_name: "default.Table_0eb776233cee4294b6c96ec556447663" } modify_external_catalogs: true
I20260620 14:47:52.471501 8341 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 2 FOLLOWER]: Refusing update from remote peer caa9dcf251944f7d97f4ed7f3d83af44: Log matching property violated. Preceding OpId in replica: term: 1 index: 50. Preceding OpId from leader: term: 2 index: 52. (index mismatch)
I20260620 14:47:52.473519 9296 consensus_queue.cc:1035] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 51, Last known committed idx: 50, Time since last communication: 0.000s
I20260620 14:47:52.477393 9291 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: SysCatalogTable state changed. Reason: New leader caa9dcf251944f7d97f4ed7f3d83af44. Latest consensus state: current_term: 2 leader_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:52.477703 9291 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:47:52.482080 9304 mvcc.cc:205] Tried to move back new op lower bound from 7298936309438996480 to 7298936308916862976. Current Snapshot: MvccSnapshot[applied={T|T < 7298936309438996480}]
I20260620 14:47:52.484205 9291 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:52.484431 9291 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:47:52.493716 8982 heartbeater.cc:503] Master 127.7.222.253:34209 was elected leader, sending a full tablet report...
I20260620 14:47:52.494272 9169 catalog_manager.cc:5495] T eb6d101c1a5444cabf7c966c7ac7134e P 36236dd5bd604ba2819038e525a3790c reported cstate change: term changed from 0 to 1, leader changed from <none> to 36236dd5bd604ba2819038e525a3790c (127.7.222.194). New cstate: current_term: 1 leader_uuid: "36236dd5bd604ba2819038e525a3790c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } health_report { overall_health: UNKNOWN } } }
I20260620 14:47:52.497138 9290 sys_catalog.cc:455] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:52.498281 9290 sys_catalog.cc:458] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: This master's current role is: LEADER
W20260620 14:47:52.502031 9225 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eb6d101c1a5444cabf7c966c7ac7134e consensus state has no leader
I20260620 14:47:52.502229 9309 mvcc.cc:205] Tried to move back new op lower bound from 7298936309438996480 to 7298936308916862976. Current Snapshot: MvccSnapshot[applied={T|T < 7298936309438996480}]
I20260620 14:47:52.505965 9297 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader caa9dcf251944f7d97f4ed7f3d83af44. Latest consensus state: current_term: 2 leader_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:52.506218 9297 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:47:52.507313 8331 catalog_manager.cc:2148] created HMS catalog entry for table [id=a17882ca0acc459caae49f8238c7df14]
W20260620 14:47:52.508600 8331 catalog_manager.cc:2176] Illegal state: an error occurred while writing to the sys-catalog: replica dd308569015348a7a19ba4a560de6d52 is not leader of this config: current role FOLLOWER
I20260620 14:47:52.509047 9168 master_service.cc:946] ReplaceTablet: received request to replace tablet 79da710506b745fb8e807b52a9dc54ab from {username='slave'} at 127.0.0.1:38546
I20260620 14:47:52.510573 8709 heartbeater.cc:503] Master 127.7.222.253:34209 was elected leader, sending a full tablet report...
I20260620 14:47:52.513931 9297 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:52.514237 9297 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:47:52.518036 9290 sys_catalog.cc:455] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:52.518321 9290 sys_catalog.cc:458] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: This master's current role is: LEADER
I20260620 14:47:52.523712 9161 catalog_manager.cc:5782] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Sending DeleteTablet for 3 replicas of tablet 38195d2af2f243dc9f9f12a2ebb0d5eb
I20260620 14:47:52.530362 9169 catalog_manager.cc:5495] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 6c99207e35f8463292d71c371c9546b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c99207e35f8463292d71c371c9546b4 (127.7.222.195). New cstate: current_term: 1 leader_uuid: "6c99207e35f8463292d71c371c9546b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } health_report { overall_health: HEALTHY } } }
I20260620 14:47:52.531419 9169 catalog_manager.cc:5495] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c99207e35f8463292d71c371c9546b4 (127.7.222.195). New cstate: current_term: 1 leader_uuid: "6c99207e35f8463292d71c371c9546b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } health_report { overall_health: HEALTHY } } }
I20260620 14:47:52.531985 9169 catalog_manager.cc:5495] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c99207e35f8463292d71c371c9546b4 (127.7.222.195). New cstate: current_term: 1 leader_uuid: "6c99207e35f8463292d71c371c9546b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } health_report { overall_health: HEALTHY } } }
I20260620 14:47:52.532482 9169 catalog_manager.cc:5587] TS 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279) does not have the latest schema for tablet eb6d101c1a5444cabf7c966c7ac7134e (table default.table_fe5ad6a8d59b4751bcbb6e1d0d4baedb [id=c514aca79062490a8b6a18021b07b2ff]). Expected version 1 got 0
I20260620 14:47:52.534911 9161 catalog_manager.cc:6565] ReplaceTablet: tablet 38195d2af2f243dc9f9f12a2ebb0d5eb deleted and replaced by tablet e4c60f9e1c724a3b99f6c25f7484fa7b
I20260620 14:47:52.539688 8912 tablet_service.cc:1514] Processing DeleteTablet for tablet 38195d2af2f243dc9f9f12a2ebb0d5eb with delete_type TABLET_DATA_DELETED (replaced by tablet e4c60f9e1c724a3b99f6c25f7484fa7b) from {username='slave'} at 127.0.0.1:56452
I20260620 14:47:52.545554 9324 tablet_replica.cc:330] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 6c99207e35f8463292d71c371c9546b4: stopping tablet replica
I20260620 14:47:52.545840 9324 raft_consensus.cc:2229] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:52.546113 9324 raft_consensus.cc:2258] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:52.546592 9161 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38546:
name: "default.Table_d2959bb621be429eb5af827263887798"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:52.550341 9324 ts_tablet_manager.cc:1905] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 6c99207e35f8463292d71c371c9546b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:52.558238 9324 ts_tablet_manager.cc:1918] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 6c99207e35f8463292d71c371c9546b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:52.558511 9324 log.cc:1196] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 6c99207e35f8463292d71c371c9546b4: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal/wals/38195d2af2f243dc9f9f12a2ebb0d5eb
I20260620 14:47:52.558903 9168 catalog_manager.cc:5587] TS c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821) does not have the latest schema for tablet eb6d101c1a5444cabf7c966c7ac7134e (table default.table_fe5ad6a8d59b4751bcbb6e1d0d4baedb [id=c514aca79062490a8b6a18021b07b2ff]). Expected version 1 got 0
I20260620 14:47:52.560124 9324 ts_tablet_manager.cc:1939] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 6c99207e35f8463292d71c371c9546b4: Deleting consensus metadata
I20260620 14:47:52.561471 9138 catalog_manager.cc:4841] TS 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): tablet 38195d2af2f243dc9f9f12a2ebb0d5eb (table default.table_7f82e63c368b415ca9ea3cd201986de1 [id=7f9c4b4af7614d20b0e5ddfbf7d2b0f5]) successfully deleted
I20260620 14:47:52.564785 8780 tablet_service.cc:1514] Processing DeleteTablet for tablet 38195d2af2f243dc9f9f12a2ebb0d5eb with delete_type TABLET_DATA_DELETED (replaced by tablet e4c60f9e1c724a3b99f6c25f7484fa7b) from {username='slave'} at 127.0.0.1:49712
I20260620 14:47:52.572685 8912 tablet_service.cc:1467] Processing CreateTablet for tablet e4c60f9e1c724a3b99f6c25f7484fa7b (DEFAULT_TABLE table=default.table_7f82e63c368b415ca9ea3cd201986de1 [id=7f9c4b4af7614d20b0e5ddfbf7d2b0f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:52.573240 8912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4c60f9e1c724a3b99f6c25f7484fa7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:52.573302 8935 raft_consensus.cc:1261] T eb6d101c1a5444cabf7c966c7ac7134e P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Refusing update from remote peer 36236dd5bd604ba2819038e525a3790c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:47:52.574189 9273 consensus_queue.cc:1035] T eb6d101c1a5444cabf7c966c7ac7134e P 36236dd5bd604ba2819038e525a3790c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:52.580345 8661 raft_consensus.cc:1261] T eb6d101c1a5444cabf7c966c7ac7134e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Refusing update from remote peer 36236dd5bd604ba2819038e525a3790c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 14:47:52.581081 9273 consensus_queue.cc:1035] T eb6d101c1a5444cabf7c966c7ac7134e P 36236dd5bd604ba2819038e525a3790c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:52.585371 9168 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38546:
name: "default.Table_563392802bec4e688c0eabd46ab1fd5c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:52.595329 9169 master_service.cc:946] ReplaceTablet: received request to replace tablet 77f744b0f04a416099d955dcba1be34a from {username='slave'} at 127.0.0.1:38546
I20260620 14:47:52.596575 8913 tablet_service.cc:1514] Processing DeleteTablet for tablet 38195d2af2f243dc9f9f12a2ebb0d5eb with delete_type TABLET_DATA_DELETED (replaced by tablet e4c60f9e1c724a3b99f6c25f7484fa7b) from {username='slave'} at 127.0.0.1:56452
W20260620 14:47:52.598129 9138 catalog_manager.cc:4808] TS 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): delete failed for tablet 38195d2af2f243dc9f9f12a2ebb0d5eb because the tablet was not found. No further retry: Not found: Tablet not found: 38195d2af2f243dc9f9f12a2ebb0d5eb
I20260620 14:47:52.603346 9169 catalog_manager.cc:5782] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Sending DeleteTablet for 3 replicas of tablet 77f744b0f04a416099d955dcba1be34a
I20260620 14:47:52.604321 8913 tablet_service.cc:1514] Processing DeleteTablet for tablet 77f744b0f04a416099d955dcba1be34a with delete_type TABLET_DATA_DELETED (replaced by tablet 2ec9ada6deb9436d83dbb08cbda596b2) from {username='slave'} at 127.0.0.1:56452
I20260620 14:47:52.604458 8779 tablet_service.cc:1467] Processing CreateTablet for tablet e4c60f9e1c724a3b99f6c25f7484fa7b (DEFAULT_TABLE table=default.table_7f82e63c368b415ca9ea3cd201986de1 [id=7f9c4b4af7614d20b0e5ddfbf7d2b0f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:52.604606 9324 tablet_replica.cc:330] T 77f744b0f04a416099d955dcba1be34a P 6c99207e35f8463292d71c371c9546b4: stopping tablet replica
I20260620 14:47:52.604589 9169 catalog_manager.cc:6565] ReplaceTablet: tablet 77f744b0f04a416099d955dcba1be34a deleted and replaced by tablet 2ec9ada6deb9436d83dbb08cbda596b2
I20260620 14:47:52.604949 8779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4c60f9e1c724a3b99f6c25f7484fa7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:52.604946 9324 raft_consensus.cc:2229] T 77f744b0f04a416099d955dcba1be34a P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:52.604967 9169 master_service.cc:946] ReplaceTablet: received request to replace tablet 38195d2af2f243dc9f9f12a2ebb0d5eb from {username='slave'} at 127.0.0.1:38546
I20260620 14:47:52.605150 9324 raft_consensus.cc:2258] T 77f744b0f04a416099d955dcba1be34a P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:52.605512 9169 master_service.cc:946] ReplaceTablet: received request to replace tablet 235446b4e9324eab836718837a0de8d5 from {username='slave'} at 127.0.0.1:38546
I20260620 14:47:52.605742 9324 ts_tablet_manager.cc:1905] T 77f744b0f04a416099d955dcba1be34a P 6c99207e35f8463292d71c371c9546b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:52.613153 9225 catalog_manager.cc:2709] Deleting table default.table_a800f01d336648a8b400cefc457c444d [id=ef56cde5526c4d9eacfbcd58922deed3] in response to Hive Metastore notification log event 20
I20260620 14:47:52.613247 9328 tablet_bootstrap.cc:492] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:52.615283 9328 tablet_bootstrap.cc:654] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:52.614135 9169 catalog_manager.cc:5782] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Sending DeleteTablet for 3 replicas of tablet 235446b4e9324eab836718837a0de8d5
I20260620 14:47:52.618094 9169 catalog_manager.cc:6565] ReplaceTablet: tablet 235446b4e9324eab836718837a0de8d5 deleted and replaced by tablet d5cc68d7852940db88064e0ca35a7cba
I20260620 14:47:52.618481 9169 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38546:
name: "default.Table_7911231c2bcb420ebe8f3e12604c29e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:52.621062 8912 tablet_service.cc:1514] Processing DeleteTablet for tablet 235446b4e9324eab836718837a0de8d5 with delete_type TABLET_DATA_DELETED (replaced by tablet d5cc68d7852940db88064e0ca35a7cba) from {username='slave'} at 127.0.0.1:56452
I20260620 14:47:52.625061 9332 tablet.cc:1722] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 14:47:52.625671 9331 tablet.cc:1722] T a4552c4e15464f21a10b6c2d83f7ead8 P 36236dd5bd604ba2819038e525a3790c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 14:47:52.626273 9330 tablet.cc:1722] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 14:47:52.627185 8777 tablet_service.cc:1514] Processing DeleteTablet for tablet 77f744b0f04a416099d955dcba1be34a with delete_type TABLET_DATA_DELETED (replaced by tablet 2ec9ada6deb9436d83dbb08cbda596b2) from {username='slave'} at 127.0.0.1:49712
I20260620 14:47:52.627975 9324 ts_tablet_manager.cc:1918] T 77f744b0f04a416099d955dcba1be34a P 6c99207e35f8463292d71c371c9546b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:52.628123 9324 log.cc:1196] T 77f744b0f04a416099d955dcba1be34a P 6c99207e35f8463292d71c371c9546b4: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal/wals/77f744b0f04a416099d955dcba1be34a
I20260620 14:47:52.628216 8777 tablet_service.cc:1514] Processing DeleteTablet for tablet 235446b4e9324eab836718837a0de8d5 with delete_type TABLET_DATA_DELETED (replaced by tablet d5cc68d7852940db88064e0ca35a7cba) from {username='slave'} at 127.0.0.1:49712
I20260620 14:47:52.629828 9324 ts_tablet_manager.cc:1939] T 77f744b0f04a416099d955dcba1be34a P 6c99207e35f8463292d71c371c9546b4: Deleting consensus metadata
I20260620 14:47:52.630885 9138 catalog_manager.cc:4841] TS 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): tablet 77f744b0f04a416099d955dcba1be34a (table default.table_a800f01d336648a8b400cefc457c444d [id=ef56cde5526c4d9eacfbcd58922deed3]) successfully deleted
I20260620 14:47:52.637156 8912 tablet_service.cc:1467] Processing CreateTablet for tablet 2ec9ada6deb9436d83dbb08cbda596b2 (DEFAULT_TABLE table=default.table_a800f01d336648a8b400cefc457c444d [id=ef56cde5526c4d9eacfbcd58922deed3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:52.637811 8912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ec9ada6deb9436d83dbb08cbda596b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:52.640854 9331 tablet.cc:1722] T eb6d101c1a5444cabf7c966c7ac7134e P 36236dd5bd604ba2819038e525a3790c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 14:47:52.644104 9225 catalog_manager.cc:5782] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Sending DeleteTablet for 3 replicas of tablet 2ec9ada6deb9436d83dbb08cbda596b2
I20260620 14:47:52.650485 8913 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ec9ada6deb9436d83dbb08cbda596b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:47:52 UTC) from {username='slave'} at 127.0.0.1:56452
I20260620 14:47:52.651072 8914 tablet_service.cc:1467] Processing CreateTablet for tablet d5cc68d7852940db88064e0ca35a7cba (DEFAULT_TABLE table=default.table_1d0410429a7242ab85d16d800ffd0502 [id=15e21d8b3d5644f8ac2112c1dd37e7ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:52.651484 8914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5cc68d7852940db88064e0ca35a7cba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:52.651706 9225 catalog_manager.cc:2709] Deleting table default.table_1d0410429a7242ab85d16d800ffd0502 [id=15e21d8b3d5644f8ac2112c1dd37e7ff] in response to Hive Metastore notification log event 22
I20260620 14:47:52.653307 8641 tablet_service.cc:1514] Processing DeleteTablet for tablet 38195d2af2f243dc9f9f12a2ebb0d5eb with delete_type TABLET_DATA_DELETED (replaced by tablet e4c60f9e1c724a3b99f6c25f7484fa7b) from {username='slave'} at 127.0.0.1:52288
I20260620 14:47:52.653393 9165 catalog_manager.cc:6040] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: default.table_e8372b71bacb4865b4360a50af59d323 [id=9c1e21a6c9244efba2e86bfa28264a0d] alter complete (version 1)
I20260620 14:47:52.653874 9165 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38546:
name: "default.Table_1d5a20c59b2741ca905b63fd9478cf1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:52.658576 8322 catalog_manager.cc:2685] deleted HMS catalog entry for table default.table_1d0410429a7242ab85d16d800ffd0502 [id=15e21d8b3d5644f8ac2112c1dd37e7ff]
I20260620 14:47:52.659332 8322 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:59860 (request call id 32) took 2515 ms. Trace:
I20260620 14:47:52.659454 8322 rpcz_store.cc:276] 0620 14:47:50.144089 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:51.648533 (+1504444us) service_pool.cc:227] Handling call
0620 14:47:52.435375 (+786842us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 14:47:52.659285 (+223910us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":71705,"Hive Metastore.run_cpu_time_us":174,"Hive Metastore.run_wall_time_us":151240}
I20260620 14:47:52.660966 9225 catalog_manager.cc:5782] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Sending DeleteTablet for 3 replicas of tablet d5cc68d7852940db88064e0ca35a7cba
W20260620 14:47:52.662432 9162 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_154fc524efb24453bdb6d735e4c741e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 14:47:52.662729 9163 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_8cc72697ee4f4200a5f57a19280315ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 14:47:52.662434 9164 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_105950e097bf4cbda12e7532557966b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 14:47:52.664553 9168 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_563392802bec4e688c0eabd46ab1fd5c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 14:47:52.664619 9167 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_16339630485f49f6a8bb2b71981cdeb1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 14:47:52.665021 9161 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_d2959bb621be429eb5af827263887798 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260620 14:47:52.665546 9169 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_7911231c2bcb420ebe8f3e12604c29e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 14:47:52.670341 9328 tablet_bootstrap.cc:492] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:52.670648 9324 tablet_replica.cc:330] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4: stopping tablet replica
I20260620 14:47:52.671312 8913 tablet_service.cc:1514] Processing DeleteTablet for tablet d5cc68d7852940db88064e0ca35a7cba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:47:52 UTC) from {username='slave'} at 127.0.0.1:56452
I20260620 14:47:52.675272 8778 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ec9ada6deb9436d83dbb08cbda596b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:47:52 UTC) from {username='slave'} at 127.0.0.1:49712
I20260620 14:47:52.675621 8775 tablet_service.cc:1514] Processing DeleteTablet for tablet d5cc68d7852940db88064e0ca35a7cba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:47:52 UTC) from {username='slave'} at 127.0.0.1:49712
I20260620 14:47:52.675879 8776 tablet_service.cc:1467] Processing CreateTablet for tablet d5cc68d7852940db88064e0ca35a7cba (DEFAULT_TABLE table=default.table_1d0410429a7242ab85d16d800ffd0502 [id=15e21d8b3d5644f8ac2112c1dd37e7ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:52.676331 8776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5cc68d7852940db88064e0ca35a7cba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:52.676817 8777 tablet_service.cc:1467] Processing CreateTablet for tablet 2ec9ada6deb9436d83dbb08cbda596b2 (DEFAULT_TABLE table=default.table_a800f01d336648a8b400cefc457c444d [id=ef56cde5526c4d9eacfbcd58922deed3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:52.677158 8777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ec9ada6deb9436d83dbb08cbda596b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:52.680341 9328 ts_tablet_manager.cc:1397] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.058s user 0.004s sys 0.000s
I20260620 14:47:52.681694 9328 raft_consensus.cc:348] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:52.681967 9328 raft_consensus.cc:374] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:52.682050 9328 raft_consensus.cc:729] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:52.682420 9328 consensus_queue.cc:260] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:52.683087 9328 ts_tablet_manager.cc:1428] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260620 14:47:52.683394 9328 tablet_bootstrap.cc:492] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:52.683497 9333 tablet_bootstrap.cc:492] T e4c60f9e1c724a3b99f6c25f7484fa7b P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:52.685119 9328 tablet_bootstrap.cc:654] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:52.685645 9333 tablet_bootstrap.cc:654] T e4c60f9e1c724a3b99f6c25f7484fa7b P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:52.686151 9326 tablet_replica.cc:330] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 36236dd5bd604ba2819038e525a3790c: stopping tablet replica
I20260620 14:47:52.685268 9324 raft_consensus.cc:2229] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:47:52.689952 9324 raft_consensus.cc:2258] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:52.690475 9324 ts_tablet_manager.cc:1905] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:52.691870 9326 raft_consensus.cc:2229] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:52.692154 9326 raft_consensus.cc:2258] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:52.692763 9326 ts_tablet_manager.cc:1905] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 36236dd5bd604ba2819038e525a3790c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:52.697539 9324 ts_tablet_manager.cc:1918] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:52.698879 9324 log.cc:1196] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal/wals/235446b4e9324eab836718837a0de8d5
I20260620 14:47:52.700591 9330 tablet.cc:1722] T eb6d101c1a5444cabf7c966c7ac7134e P 6c99207e35f8463292d71c371c9546b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 14:47:52.704771 9324 ts_tablet_manager.cc:1939] T 235446b4e9324eab836718837a0de8d5 P 6c99207e35f8463292d71c371c9546b4: Deleting consensus metadata
I20260620 14:47:52.707170 9333 tablet_bootstrap.cc:492] T e4c60f9e1c724a3b99f6c25f7484fa7b P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
W20260620 14:47:52.707266 9138 catalog_manager.cc:4821] TS 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): delete failed for tablet 2ec9ada6deb9436d83dbb08cbda596b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ec9ada6deb9436d83dbb08cbda596b2 already in progress: creating tablet
I20260620 14:47:52.708262 9333 ts_tablet_manager.cc:1397] T e4c60f9e1c724a3b99f6c25f7484fa7b P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
W20260620 14:47:52.708683 9138 catalog_manager.cc:4821] TS 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): delete failed for tablet d5cc68d7852940db88064e0ca35a7cba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d5cc68d7852940db88064e0ca35a7cba already in progress: creating tablet
I20260620 14:47:52.709694 9333 raft_consensus.cc:348] T e4c60f9e1c724a3b99f6c25f7484fa7b P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:52.710006 9333 raft_consensus.cc:374] T e4c60f9e1c724a3b99f6c25f7484fa7b P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:52.710160 9333 raft_consensus.cc:729] T e4c60f9e1c724a3b99f6c25f7484fa7b P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:52.710507 9333 consensus_queue.cc:260] T e4c60f9e1c724a3b99f6c25f7484fa7b P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:52.715505 9333 ts_tablet_manager.cc:1428] T e4c60f9e1c724a3b99f6c25f7484fa7b P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260620 14:47:52.717912 8642 tablet_service.cc:1467] Processing CreateTablet for tablet e4c60f9e1c724a3b99f6c25f7484fa7b (DEFAULT_TABLE table=default.table_7f82e63c368b415ca9ea3cd201986de1 [id=7f9c4b4af7614d20b0e5ddfbf7d2b0f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:52.718438 8642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4c60f9e1c724a3b99f6c25f7484fa7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:52.719714 9333 tablet_bootstrap.cc:492] T 2ec9ada6deb9436d83dbb08cbda596b2 P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:52.724486 9326 ts_tablet_manager.cc:1918] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 36236dd5bd604ba2819038e525a3790c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:52.724697 9326 log.cc:1196] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 36236dd5bd604ba2819038e525a3790c: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal/wals/38195d2af2f243dc9f9f12a2ebb0d5eb
I20260620 14:47:52.725243 9326 ts_tablet_manager.cc:1939] T 38195d2af2f243dc9f9f12a2ebb0d5eb P 36236dd5bd604ba2819038e525a3790c: Deleting consensus metadata
I20260620 14:47:52.725399 9333 tablet_bootstrap.cc:654] T 2ec9ada6deb9436d83dbb08cbda596b2 P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:52.727416 9326 tablet_replica.cc:330] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c: stopping tablet replica
I20260620 14:47:52.727134 9342 tablet_bootstrap.cc:492] T e4c60f9e1c724a3b99f6c25f7484fa7b P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:52.727319 8640 tablet_service.cc:1514] Processing DeleteTablet for tablet 77f744b0f04a416099d955dcba1be34a with delete_type TABLET_DATA_DELETED (replaced by tablet 2ec9ada6deb9436d83dbb08cbda596b2) from {username='slave'} at 127.0.0.1:52288
I20260620 14:47:52.727741 9326 raft_consensus.cc:2229] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:47:52.727926 8640 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ec9ada6deb9436d83dbb08cbda596b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:47:52 UTC) from {username='slave'} at 127.0.0.1:52288
I20260620 14:47:52.727456 8639 tablet_service.cc:1514] Processing DeleteTablet for tablet 235446b4e9324eab836718837a0de8d5 with delete_type TABLET_DATA_DELETED (replaced by tablet d5cc68d7852940db88064e0ca35a7cba) from {username='slave'} at 127.0.0.1:52288
I20260620 14:47:52.728226 9326 raft_consensus.cc:2258] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:52.728986 9326 ts_tablet_manager.cc:1905] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:52.731778 8637 tablet_service.cc:1467] Processing CreateTablet for tablet d5cc68d7852940db88064e0ca35a7cba (DEFAULT_TABLE table=default.table_1d0410429a7242ab85d16d800ffd0502 [id=15e21d8b3d5644f8ac2112c1dd37e7ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:52.732266 8638 tablet_service.cc:1467] Processing CreateTablet for tablet 2ec9ada6deb9436d83dbb08cbda596b2 (DEFAULT_TABLE table=default.table_a800f01d336648a8b400cefc457c444d [id=ef56cde5526c4d9eacfbcd58922deed3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:52.732793 8637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5cc68d7852940db88064e0ca35a7cba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:52.733767 9140 catalog_manager.cc:4841] TS 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): tablet 38195d2af2f243dc9f9f12a2ebb0d5eb (table default.table_7f82e63c368b415ca9ea3cd201986de1 [id=7f9c4b4af7614d20b0e5ddfbf7d2b0f5]) successfully deleted
I20260620 14:47:52.735177 9326 ts_tablet_manager.cc:1918] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:52.735309 9326 log.cc:1196] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal/wals/77f744b0f04a416099d955dcba1be34a
I20260620 14:47:52.736301 9332 tablet.cc:1722] T eb6d101c1a5444cabf7c966c7ac7134e P c0e6c57ab91e42bf9be3739c816916c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 14:47:52.736815 8638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ec9ada6deb9436d83dbb08cbda596b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:52.742733 9326 ts_tablet_manager.cc:1939] T 77f744b0f04a416099d955dcba1be34a P 36236dd5bd604ba2819038e525a3790c: Deleting consensus metadata
I20260620 14:47:52.744982 9326 tablet_replica.cc:330] T 235446b4e9324eab836718837a0de8d5 P 36236dd5bd604ba2819038e525a3790c: stopping tablet replica
I20260620 14:47:52.745884 9326 raft_consensus.cc:2229] T 235446b4e9324eab836718837a0de8d5 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:52.746836 9326 raft_consensus.cc:2258] T 235446b4e9324eab836718837a0de8d5 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:52.747752 9326 ts_tablet_manager.cc:1905] T 235446b4e9324eab836718837a0de8d5 P 36236dd5bd604ba2819038e525a3790c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:52.753983 8529 catalog_manager.cc:1602] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 14:47:52.760673 9326 ts_tablet_manager.cc:1918] T 235446b4e9324eab836718837a0de8d5 P 36236dd5bd604ba2819038e525a3790c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:52.763548 9326 log.cc:1196] T 235446b4e9324eab836718837a0de8d5 P 36236dd5bd604ba2819038e525a3790c: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal/wals/235446b4e9324eab836718837a0de8d5
I20260620 14:47:52.764405 9326 ts_tablet_manager.cc:1939] T 235446b4e9324eab836718837a0de8d5 P 36236dd5bd604ba2819038e525a3790c: Deleting consensus metadata
W20260620 14:47:52.768198 9140 catalog_manager.cc:4821] TS 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): delete failed for tablet 2ec9ada6deb9436d83dbb08cbda596b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ec9ada6deb9436d83dbb08cbda596b2 already in progress: creating tablet
W20260620 14:47:52.769479 9140 catalog_manager.cc:4821] TS 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): delete failed for tablet d5cc68d7852940db88064e0ca35a7cba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d5cc68d7852940db88064e0ca35a7cba already in progress: creating tablet
I20260620 14:47:52.778748 9337 tablet_replica.cc:330] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0: stopping tablet replica
I20260620 14:47:52.779109 9337 raft_consensus.cc:2229] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:47:52.779598 9337 raft_consensus.cc:2258] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:52.780978 9337 ts_tablet_manager.cc:1905] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:52.783704 8638 tablet_service.cc:1514] Processing DeleteTablet for tablet d5cc68d7852940db88064e0ca35a7cba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:47:52 UTC) from {username='slave'} at 127.0.0.1:52288
I20260620 14:47:52.786273 9328 tablet_bootstrap.cc:492] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:52.787482 9330 tablet.cc:1722] T 675413dc550f485dbef0d180ed27ff0e P 6c99207e35f8463292d71c371c9546b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 14:47:52.787636 9328 ts_tablet_manager.cc:1397] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.104s user 0.031s sys 0.022s
I20260620 14:47:52.788813 9328 raft_consensus.cc:348] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:52.788957 9331 tablet.cc:1722] T 675413dc550f485dbef0d180ed27ff0e P 36236dd5bd604ba2819038e525a3790c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 14:47:52.790172 9328 raft_consensus.cc:374] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:52.790282 9328 raft_consensus.cc:729] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:52.790556 9328 consensus_queue.cc:260] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:52.791133 9328 ts_tablet_manager.cc:1428] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260620 14:47:52.793629 9328 tablet_bootstrap.cc:492] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:52.795702 9328 tablet_bootstrap.cc:654] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:52.796892 9342 tablet_bootstrap.cc:654] T e4c60f9e1c724a3b99f6c25f7484fa7b P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:52.802755 9331 tablet.cc:1722] T bd541e6a431348c7a506611681730fc5 P 36236dd5bd604ba2819038e525a3790c: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 14:47:52.807261 9330 tablet.cc:1722] T bd541e6a431348c7a506611681730fc5 P 6c99207e35f8463292d71c371c9546b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 14:47:52.809381 9332 tablet.cc:1722] T bd541e6a431348c7a506611681730fc5 P c0e6c57ab91e42bf9be3739c816916c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 14:47:52.810384 9342 tablet_bootstrap.cc:492] T e4c60f9e1c724a3b99f6c25f7484fa7b P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:52.810525 9342 ts_tablet_manager.cc:1397] T e4c60f9e1c724a3b99f6c25f7484fa7b P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.083s user 0.004s sys 0.000s
I20260620 14:47:52.811233 9342 raft_consensus.cc:348] T e4c60f9e1c724a3b99f6c25f7484fa7b P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:52.811524 9342 raft_consensus.cc:374] T e4c60f9e1c724a3b99f6c25f7484fa7b P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:52.811602 9342 raft_consensus.cc:729] T e4c60f9e1c724a3b99f6c25f7484fa7b P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:52.811784 9342 consensus_queue.cc:260] T e4c60f9e1c724a3b99f6c25f7484fa7b P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:52.812327 9342 ts_tablet_manager.cc:1428] T e4c60f9e1c724a3b99f6c25f7484fa7b P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 14:47:52.812608 9342 tablet_bootstrap.cc:492] T d5cc68d7852940db88064e0ca35a7cba P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:52.822089 9351 tablet.cc:1722] T 675413dc550f485dbef0d180ed27ff0e P c0e6c57ab91e42bf9be3739c816916c0: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260620 14:47:52.822701 9342 tablet_bootstrap.cc:654] T d5cc68d7852940db88064e0ca35a7cba P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:52.822810 9337 ts_tablet_manager.cc:1918] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:52.827319 9337 log.cc:1196] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/wal/wals/38195d2af2f243dc9f9f12a2ebb0d5eb
I20260620 14:47:52.828006 9337 ts_tablet_manager.cc:1939] T 38195d2af2f243dc9f9f12a2ebb0d5eb P c0e6c57ab91e42bf9be3739c816916c0: Deleting consensus metadata
I20260620 14:47:52.829511 9337 tablet_replica.cc:330] T 77f744b0f04a416099d955dcba1be34a P c0e6c57ab91e42bf9be3739c816916c0: stopping tablet replica
I20260620 14:47:52.829658 9138 catalog_manager.cc:4841] TS c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821): tablet 38195d2af2f243dc9f9f12a2ebb0d5eb (table default.table_7f82e63c368b415ca9ea3cd201986de1 [id=7f9c4b4af7614d20b0e5ddfbf7d2b0f5]) successfully deleted
I20260620 14:47:52.831389 9333 tablet_bootstrap.cc:492] T 2ec9ada6deb9436d83dbb08cbda596b2 P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:52.831568 9333 ts_tablet_manager.cc:1397] T 2ec9ada6deb9436d83dbb08cbda596b2 P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.112s user 0.017s sys 0.010s
I20260620 14:47:52.832289 9337 raft_consensus.cc:2229] T 77f744b0f04a416099d955dcba1be34a P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:52.832479 9337 raft_consensus.cc:2258] T 77f744b0f04a416099d955dcba1be34a P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:52.832367 9333 raft_consensus.cc:348] T 2ec9ada6deb9436d83dbb08cbda596b2 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:52.832587 9333 raft_consensus.cc:374] T 2ec9ada6deb9436d83dbb08cbda596b2 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:52.832654 9333 raft_consensus.cc:729] T 2ec9ada6deb9436d83dbb08cbda596b2 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:52.832923 9333 consensus_queue.cc:260] T 2ec9ada6deb9436d83dbb08cbda596b2 P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:52.833573 9333 ts_tablet_manager.cc:1428] T 2ec9ada6deb9436d83dbb08cbda596b2 P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 14:47:52.833760 9337 ts_tablet_manager.cc:1905] T 77f744b0f04a416099d955dcba1be34a P c0e6c57ab91e42bf9be3739c816916c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:52.841393 9333 tablet_bootstrap.cc:492] T d5cc68d7852940db88064e0ca35a7cba P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:52.842408 9328 tablet_bootstrap.cc:492] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:52.842569 9328 ts_tablet_manager.cc:1397] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.049s user 0.006s sys 0.004s
I20260620 14:47:52.843346 9328 raft_consensus.cc:348] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:52.843569 9328 raft_consensus.cc:374] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:52.843660 9328 raft_consensus.cc:729] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:52.843890 9328 consensus_queue.cc:260] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:52.848011 9337 ts_tablet_manager.cc:1918] T 77f744b0f04a416099d955dcba1be34a P c0e6c57ab91e42bf9be3739c816916c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:52.848186 9337 log.cc:1196] T 77f744b0f04a416099d955dcba1be34a P c0e6c57ab91e42bf9be3739c816916c0: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/wal/wals/77f744b0f04a416099d955dcba1be34a
I20260620 14:47:52.848627 9337 ts_tablet_manager.cc:1939] T 77f744b0f04a416099d955dcba1be34a P c0e6c57ab91e42bf9be3739c816916c0: Deleting consensus metadata
I20260620 14:47:52.849977 9333 tablet_bootstrap.cc:654] T d5cc68d7852940db88064e0ca35a7cba P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:52.852586 9328 ts_tablet_manager.cc:1428] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260620 14:47:52.853358 9228 consensus_queue.cc:1035] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:52.855473 9337 tablet_replica.cc:330] T 235446b4e9324eab836718837a0de8d5 P c0e6c57ab91e42bf9be3739c816916c0: stopping tablet replica
I20260620 14:47:52.855738 9337 raft_consensus.cc:2229] T 235446b4e9324eab836718837a0de8d5 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:52.855979 9337 raft_consensus.cc:2258] T 235446b4e9324eab836718837a0de8d5 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260620 14:47:52.856025 9138 catalog_manager.cc:4821] TS c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821): delete failed for tablet 2ec9ada6deb9436d83dbb08cbda596b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ec9ada6deb9436d83dbb08cbda596b2 already in progress: creating tablet
I20260620 14:47:52.856432 9342 tablet_bootstrap.cc:492] T d5cc68d7852940db88064e0ca35a7cba P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:52.856592 9342 ts_tablet_manager.cc:1397] T d5cc68d7852940db88064e0ca35a7cba P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.044s user 0.005s sys 0.006s
I20260620 14:47:52.856642 9337 ts_tablet_manager.cc:1905] T 235446b4e9324eab836718837a0de8d5 P c0e6c57ab91e42bf9be3739c816916c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:52.857847 9342 raft_consensus.cc:348] T d5cc68d7852940db88064e0ca35a7cba P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:52.858146 9342 raft_consensus.cc:374] T d5cc68d7852940db88064e0ca35a7cba P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:52.858258 9342 raft_consensus.cc:729] T d5cc68d7852940db88064e0ca35a7cba P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:52.858565 9342 consensus_queue.cc:260] T d5cc68d7852940db88064e0ca35a7cba P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:52.859206 9342 ts_tablet_manager.cc:1428] T d5cc68d7852940db88064e0ca35a7cba P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260620 14:47:52.859586 9342 tablet_bootstrap.cc:492] T 2ec9ada6deb9436d83dbb08cbda596b2 P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:52.861485 9342 tablet_bootstrap.cc:654] T 2ec9ada6deb9436d83dbb08cbda596b2 P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:52.864492 9337 ts_tablet_manager.cc:1918] T 235446b4e9324eab836718837a0de8d5 P c0e6c57ab91e42bf9be3739c816916c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:52.864681 9337 log.cc:1196] T 235446b4e9324eab836718837a0de8d5 P c0e6c57ab91e42bf9be3739c816916c0: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/wal/wals/235446b4e9324eab836718837a0de8d5
I20260620 14:47:52.865188 9337 ts_tablet_manager.cc:1939] T 235446b4e9324eab836718837a0de8d5 P c0e6c57ab91e42bf9be3739c816916c0: Deleting consensus metadata
I20260620 14:47:52.866536 9228 consensus_queue.cc:1035] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:52.866797 9337 tablet_replica.cc:330] T d5cc68d7852940db88064e0ca35a7cba P c0e6c57ab91e42bf9be3739c816916c0: stopping tablet replica
I20260620 14:47:52.867091 9337 raft_consensus.cc:2229] T d5cc68d7852940db88064e0ca35a7cba P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:52.867256 9337 raft_consensus.cc:2258] T d5cc68d7852940db88064e0ca35a7cba P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:52.868273 9337 ts_tablet_manager.cc:1905] T d5cc68d7852940db88064e0ca35a7cba P c0e6c57ab91e42bf9be3739c816916c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:52.875547 9337 ts_tablet_manager.cc:1918] T d5cc68d7852940db88064e0ca35a7cba P c0e6c57ab91e42bf9be3739c816916c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 14:47:52.875765 9337 log.cc:1196] T d5cc68d7852940db88064e0ca35a7cba P c0e6c57ab91e42bf9be3739c816916c0: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/wal/wals/d5cc68d7852940db88064e0ca35a7cba
I20260620 14:47:52.876183 9337 ts_tablet_manager.cc:1939] T d5cc68d7852940db88064e0ca35a7cba P c0e6c57ab91e42bf9be3739c816916c0: Deleting consensus metadata
I20260620 14:47:52.877296 9138 catalog_manager.cc:4841] TS c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821): tablet d5cc68d7852940db88064e0ca35a7cba (table default.table_1d0410429a7242ab85d16d800ffd0502 [id=15e21d8b3d5644f8ac2112c1dd37e7ff]) successfully deleted
I20260620 14:47:52.878518 9342 tablet_bootstrap.cc:492] T 2ec9ada6deb9436d83dbb08cbda596b2 P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:52.878703 9342 ts_tablet_manager.cc:1397] T 2ec9ada6deb9436d83dbb08cbda596b2 P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260620 14:47:52.879478 9342 raft_consensus.cc:348] T 2ec9ada6deb9436d83dbb08cbda596b2 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:52.879735 9342 raft_consensus.cc:374] T 2ec9ada6deb9436d83dbb08cbda596b2 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:52.879853 9342 raft_consensus.cc:729] T 2ec9ada6deb9436d83dbb08cbda596b2 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:52.880100 9342 consensus_queue.cc:260] T 2ec9ada6deb9436d83dbb08cbda596b2 P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:52.880671 9342 ts_tablet_manager.cc:1428] T 2ec9ada6deb9436d83dbb08cbda596b2 P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 14:47:52.899103 9234 consensus_queue.cc:1035] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:52.904549 8326 catalog_manager.cc:2148] created HMS catalog entry for table [id=dd35f6770b3f4a91b60918c68c38b8a5]
W20260620 14:47:52.905434 8326 catalog_manager.cc:2176] Illegal state: an error occurred while writing to the sys-catalog: replica dd308569015348a7a19ba4a560de6d52 is not leader of this config: current role FOLLOWER
I20260620 14:47:52.907459 9163 catalog_manager.cc:2148] created HMS catalog entry for table [id=1db81c7e90894c5fac0e8fe34d1d4441]
I20260620 14:47:52.913695 9333 tablet_bootstrap.cc:492] T d5cc68d7852940db88064e0ca35a7cba P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:52.914203 9333 ts_tablet_manager.cc:1397] T d5cc68d7852940db88064e0ca35a7cba P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.073s user 0.010s sys 0.014s
I20260620 14:47:52.915028 9333 raft_consensus.cc:348] T d5cc68d7852940db88064e0ca35a7cba P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:52.915264 9333 raft_consensus.cc:374] T d5cc68d7852940db88064e0ca35a7cba P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:52.915366 9333 raft_consensus.cc:729] T d5cc68d7852940db88064e0ca35a7cba P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:52.915599 9333 consensus_queue.cc:260] T d5cc68d7852940db88064e0ca35a7cba P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:52.916144 9333 ts_tablet_manager.cc:1428] T d5cc68d7852940db88064e0ca35a7cba P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 14:47:52.924026 9228 consensus_queue.cc:1035] T 8caaa1b5e0384a6ab49b9fd7162896c8 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:52.938884 8638 tablet_service.cc:1467] Processing CreateTablet for tablet c4e5daabb2954a6f955fd4857b362884 (DEFAULT_TABLE table=default.table_8cc72697ee4f4200a5f57a19280315ee [id=1db81c7e90894c5fac0e8fe34d1d4441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:52.939417 8638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4e5daabb2954a6f955fd4857b362884. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:52.945463 8914 tablet_service.cc:1467] Processing CreateTablet for tablet c4e5daabb2954a6f955fd4857b362884 (DEFAULT_TABLE table=default.table_8cc72697ee4f4200a5f57a19280315ee [id=1db81c7e90894c5fac0e8fe34d1d4441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:52.945955 8914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4e5daabb2954a6f955fd4857b362884. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:52.947678 9228 consensus_queue.cc:1035] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:52.949205 9228 raft_consensus.cc:482] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:52.949329 8776 tablet_service.cc:1467] Processing CreateTablet for tablet c4e5daabb2954a6f955fd4857b362884 (DEFAULT_TABLE table=default.table_8cc72697ee4f4200a5f57a19280315ee [id=1db81c7e90894c5fac0e8fe34d1d4441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:52.949363 9228 raft_consensus.cc:504] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:52.949736 8776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4e5daabb2954a6f955fd4857b362884. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:52.949884 9228 leader_election.cc:288] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:47:52.950441 8798 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ec9ada6deb9436d83dbb08cbda596b2" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:47:52.950739 8798 raft_consensus.cc:2454] T 2ec9ada6deb9436d83dbb08cbda596b2 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:52.952620 8871 leader_election.cc:302] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4; no voters:
I20260620 14:47:52.953369 8662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ec9ada6deb9436d83dbb08cbda596b2" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:47:52.953608 8662 raft_consensus.cc:2454] T 2ec9ada6deb9436d83dbb08cbda596b2 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:52.954270 9228 raft_consensus.cc:2781] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:52.954365 9228 raft_consensus.cc:482] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:52.954461 9228 raft_consensus.cc:3037] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:52.957551 9228 raft_consensus.cc:504] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:52.958499 8798 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ec9ada6deb9436d83dbb08cbda596b2" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:47:52.958696 8798 raft_consensus.cc:3037] T 2ec9ada6deb9436d83dbb08cbda596b2 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:52.959077 9163 catalog_manager.cc:6040] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: default.table_fe5ad6a8d59b4751bcbb6e1d0d4baedb [id=c514aca79062490a8b6a18021b07b2ff] alter complete (version 1)
I20260620 14:47:52.960359 9163 catalog_manager.cc:5587] TS c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821) does not have the latest schema for tablet eb6d101c1a5444cabf7c966c7ac7134e (table default.table_fe5ad6a8d59b4751bcbb6e1d0d4baedb [id=c514aca79062490a8b6a18021b07b2ff]). Expected version 1 got 0
I20260620 14:47:52.962095 9163 catalog_manager.cc:5587] TS 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279) does not have the latest schema for tablet eb6d101c1a5444cabf7c966c7ac7134e (table default.table_fe5ad6a8d59b4751bcbb6e1d0d4baedb [id=c514aca79062490a8b6a18021b07b2ff]). Expected version 1 got 0
I20260620 14:47:52.962234 8798 raft_consensus.cc:2454] T 2ec9ada6deb9436d83dbb08cbda596b2 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:52.962678 8871 leader_election.cc:302] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4; no voters:
I20260620 14:47:52.962894 9163 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38546:
table { table_name: "default.Table_fdbead99862d49af98df44683e830bf5" } new_table_name: "default.Table_d287e3d931c34a68ae38252d5c848e4c" modify_external_catalogs: true
I20260620 14:47:52.962999 9062 raft_consensus.cc:2781] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:52.963133 9062 raft_consensus.cc:686] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Becoming Leader. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Running, Role: LEADER
I20260620 14:47:52.963358 9062 consensus_queue.cc:237] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:52.966804 9342 tablet_bootstrap.cc:492] T c4e5daabb2954a6f955fd4857b362884 P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:52.966759 9234 consensus_queue.cc:1035] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:52.968705 9342 tablet_bootstrap.cc:654] T c4e5daabb2954a6f955fd4857b362884 P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:52.978116 9062 raft_consensus.cc:482] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:52.978277 9062 raft_consensus.cc:504] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:52.979242 9062 leader_election.cc:288] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:47:52.979923 9228 leader_election.cc:288] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Requested vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:47:52.983955 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ec9ada6deb9436d83dbb08cbda596b2" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:47:52.984198 8659 raft_consensus.cc:3037] T 2ec9ada6deb9436d83dbb08cbda596b2 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
W20260620 14:47:52.984194 8869 leader_election.cc:341] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821): Not found: Tablet not found: d5cc68d7852940db88064e0ca35a7cba
I20260620 14:47:52.988029 8659 raft_consensus.cc:2454] T 2ec9ada6deb9436d83dbb08cbda596b2 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:52.989274 8798 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5cc68d7852940db88064e0ca35a7cba" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:47:52.989629 8798 raft_consensus.cc:2454] T d5cc68d7852940db88064e0ca35a7cba P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:52.990151 8871 leader_election.cc:302] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4; no voters: c0e6c57ab91e42bf9be3739c816916c0
I20260620 14:47:52.990661 9228 raft_consensus.cc:2781] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:52.990840 9228 raft_consensus.cc:482] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:52.991004 9228 raft_consensus.cc:3037] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:52.991552 8323 catalog_manager.cc:2685] deleted HMS catalog entry for table default.table_7f82e63c368b415ca9ea3cd201986de1 [id=7f9c4b4af7614d20b0e5ddfbf7d2b0f5]
I20260620 14:47:52.992208 8323 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:59860 (request call id 34) took 2800 ms. Trace:
I20260620 14:47:52.992322 8323 rpcz_store.cc:276] 0620 14:47:50.191908 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:51.663602 (+1471694us) service_pool.cc:227] Handling call
0620 14:47:52.437457 (+773855us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 14:47:52.992141 (+554684us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":466745,"Hive Metastore.run_cpu_time_us":202,"Hive Metastore.run_wall_time_us":86964}
I20260620 14:47:52.994248 9328 tablet_bootstrap.cc:492] T c4e5daabb2954a6f955fd4857b362884 P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:52.995677 9333 tablet_bootstrap.cc:492] T c4e5daabb2954a6f955fd4857b362884 P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:52.995946 9328 tablet_bootstrap.cc:654] T c4e5daabb2954a6f955fd4857b362884 P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:52.998103 9333 tablet_bootstrap.cc:654] T c4e5daabb2954a6f955fd4857b362884 P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:53.015054 9333 tablet_bootstrap.cc:492] T c4e5daabb2954a6f955fd4857b362884 P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:53.015362 9333 ts_tablet_manager.cc:1397] T c4e5daabb2954a6f955fd4857b362884 P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.006s
I20260620 14:47:53.015345 9228 raft_consensus.cc:504] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.016089 9333 raft_consensus.cc:348] T c4e5daabb2954a6f955fd4857b362884 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.016773 9333 raft_consensus.cc:374] T c4e5daabb2954a6f955fd4857b362884 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:53.016891 9333 raft_consensus.cc:729] T c4e5daabb2954a6f955fd4857b362884 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:53.017066 8798 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5cc68d7852940db88064e0ca35a7cba" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:47:53.017307 8798 raft_consensus.cc:3037] T d5cc68d7852940db88064e0ca35a7cba P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:53.017197 9333 consensus_queue.cc:260] T c4e5daabb2954a6f955fd4857b362884 P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.018042 9333 ts_tablet_manager.cc:1428] T c4e5daabb2954a6f955fd4857b362884 P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260620 14:47:53.020221 8798 raft_consensus.cc:2454] T d5cc68d7852940db88064e0ca35a7cba P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:53.020717 8871 leader_election.cc:302] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4; no voters:
I20260620 14:47:53.021129 9328 tablet_bootstrap.cc:492] T c4e5daabb2954a6f955fd4857b362884 P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:53.021299 9328 ts_tablet_manager.cc:1397] T c4e5daabb2954a6f955fd4857b362884 P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.027s user 0.010s sys 0.000s
W20260620 14:47:53.022029 8869 leader_election.cc:341] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821): Not found: Tablet not found: d5cc68d7852940db88064e0ca35a7cba
I20260620 14:47:53.022209 9228 leader_election.cc:288] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Requested vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:47:53.022475 9228 raft_consensus.cc:2781] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:53.022720 9228 raft_consensus.cc:686] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Becoming Leader. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Running, Role: LEADER
I20260620 14:47:53.022994 9228 consensus_queue.cc:237] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.024528 9328 raft_consensus.cc:348] T c4e5daabb2954a6f955fd4857b362884 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.025156 9328 raft_consensus.cc:374] T c4e5daabb2954a6f955fd4857b362884 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:53.025235 9328 raft_consensus.cc:729] T c4e5daabb2954a6f955fd4857b362884 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:53.025449 9328 consensus_queue.cc:260] T c4e5daabb2954a6f955fd4857b362884 P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.025967 9328 ts_tablet_manager.cc:1428] T c4e5daabb2954a6f955fd4857b362884 P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260620 14:47:53.026996 9342 tablet_bootstrap.cc:492] T c4e5daabb2954a6f955fd4857b362884 P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:53.027168 9342 ts_tablet_manager.cc:1397] T c4e5daabb2954a6f955fd4857b362884 P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.060s user 0.011s sys 0.003s
I20260620 14:47:53.027891 9342 raft_consensus.cc:348] T c4e5daabb2954a6f955fd4857b362884 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.028127 9342 raft_consensus.cc:374] T c4e5daabb2954a6f955fd4857b362884 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:53.028199 9342 raft_consensus.cc:729] T c4e5daabb2954a6f955fd4857b362884 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:53.028445 9342 consensus_queue.cc:260] T c4e5daabb2954a6f955fd4857b362884 P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.032444 9342 ts_tablet_manager.cc:1428] T c4e5daabb2954a6f955fd4857b362884 P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260620 14:47:53.072696 9228 raft_consensus.cc:482] T c4e5daabb2954a6f955fd4857b362884 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:53.072956 9228 raft_consensus.cc:504] T c4e5daabb2954a6f955fd4857b362884 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.073684 9228 leader_election.cc:288] T c4e5daabb2954a6f955fd4857b362884 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:47:53.074529 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4e5daabb2954a6f955fd4857b362884" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:47:53.074810 8799 raft_consensus.cc:2454] T c4e5daabb2954a6f955fd4857b362884 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:53.074878 8662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4e5daabb2954a6f955fd4857b362884" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:47:53.075177 8662 raft_consensus.cc:2454] T c4e5daabb2954a6f955fd4857b362884 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:53.075279 8871 leader_election.cc:302] T c4e5daabb2954a6f955fd4857b362884 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4; no voters:
I20260620 14:47:53.075575 9228 raft_consensus.cc:2781] T c4e5daabb2954a6f955fd4857b362884 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:53.075664 9228 raft_consensus.cc:482] T c4e5daabb2954a6f955fd4857b362884 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:53.075758 9228 raft_consensus.cc:3037] T c4e5daabb2954a6f955fd4857b362884 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:53.083081 9164 catalog_manager.cc:2148] created HMS catalog entry for table [id=34076de884f942fcb696a9c9524941e7]
I20260620 14:47:53.085474 9228 raft_consensus.cc:504] T c4e5daabb2954a6f955fd4857b362884 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.087955 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4e5daabb2954a6f955fd4857b362884" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:47:53.088205 8799 raft_consensus.cc:3037] T c4e5daabb2954a6f955fd4857b362884 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:53.090898 8799 raft_consensus.cc:2454] T c4e5daabb2954a6f955fd4857b362884 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:53.091400 8871 leader_election.cc:302] T c4e5daabb2954a6f955fd4857b362884 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4; no voters:
I20260620 14:47:53.091754 9234 raft_consensus.cc:2781] T c4e5daabb2954a6f955fd4857b362884 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:53.091894 9234 raft_consensus.cc:686] T c4e5daabb2954a6f955fd4857b362884 P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Becoming Leader. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Running, Role: LEADER
I20260620 14:47:53.092115 9234 consensus_queue.cc:237] T c4e5daabb2954a6f955fd4857b362884 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.098822 8662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4e5daabb2954a6f955fd4857b362884" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:47:53.099094 8662 raft_consensus.cc:3037] T c4e5daabb2954a6f955fd4857b362884 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:53.102155 8662 raft_consensus.cc:2454] T c4e5daabb2954a6f955fd4857b362884 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:53.102619 9228 leader_election.cc:288] T c4e5daabb2954a6f955fd4857b362884 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Requested vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:47:53.102846 8638 tablet_service.cc:1467] Processing CreateTablet for tablet cfb843392987415ca86f344e28de15a5 (DEFAULT_TABLE table=default.table_105950e097bf4cbda12e7532557966b2 [id=34076de884f942fcb696a9c9524941e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:53.103256 8638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfb843392987415ca86f344e28de15a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:53.109594 8914 tablet_service.cc:1467] Processing CreateTablet for tablet cfb843392987415ca86f344e28de15a5 (DEFAULT_TABLE table=default.table_105950e097bf4cbda12e7532557966b2 [id=34076de884f942fcb696a9c9524941e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:53.110016 8914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfb843392987415ca86f344e28de15a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:53.113677 8776 tablet_service.cc:1467] Processing CreateTablet for tablet cfb843392987415ca86f344e28de15a5 (DEFAULT_TABLE table=default.table_105950e097bf4cbda12e7532557966b2 [id=34076de884f942fcb696a9c9524941e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:53.114100 8776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfb843392987415ca86f344e28de15a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:53.118546 9342 tablet_bootstrap.cc:492] T cfb843392987415ca86f344e28de15a5 P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:53.119933 9328 tablet_bootstrap.cc:492] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:53.120592 9342 tablet_bootstrap.cc:654] T cfb843392987415ca86f344e28de15a5 P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:53.121694 9328 tablet_bootstrap.cc:654] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:53.124840 8325 catalog_manager.cc:2685] deleted HMS catalog entry for table default.table_de1c78a84d1349dea4d9e9d032a258be [id=a78802b888ed44b5b439381a6890a67d]
I20260620 14:47:53.125416 8325 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:59860 (request call id 35) took 2851 ms. Trace:
I20260620 14:47:53.125569 8325 rpcz_store.cc:276] 0620 14:47:50.274113 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:51.675113 (+1401000us) service_pool.cc:227] Handling call
0620 14:47:51.693778 (+ 18665us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x615000033024. stack: 00007f929b55e66e 00007f929b55e430 00007f929a5e55ed 00000000008ea064 00000000008ea02d 00007f92a9c7727d 00007f92a9c77373 00007f92a6a99361 00007f92ae40c66a 00007f92ae5952e6 00007f92a5888126 00007f92a5887e55 00007f92a209a9be 00007f92a209979e 00007f92a209fb25 00007f92a20a054f
0620 14:47:52.437621 (+743843us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0620 14:47:53.125377 (+687756us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":553645,"Hive Metastore.run_cpu_time_us":230,"Hive Metastore.run_wall_time_us":133255,"spinlock_wait_cycles":42118400}
I20260620 14:47:53.129333 9164 catalog_manager.cc:6040] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: default.table_a901d915c377429a9e43cfcaf071e7d3 [id=c65e926af55d4fbba6c42f4d2ddbb397] alter complete (version 1)
I20260620 14:47:53.141875 9164 catalog_manager.cc:6040] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: default.table_4ab72ecdb6d540508f6f4b250020b540 [id=0c4867ea1c1e45f388ccd4e2c9de093e] alter complete (version 1)
I20260620 14:47:53.145352 8638 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ec9ada6deb9436d83dbb08cbda596b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:47:52 UTC) from {username='slave'} at 127.0.0.1:52288
I20260620 14:47:53.145740 9337 tablet_replica.cc:330] T 2ec9ada6deb9436d83dbb08cbda596b2 P c0e6c57ab91e42bf9be3739c816916c0: stopping tablet replica
I20260620 14:47:53.145965 9337 raft_consensus.cc:2229] T 2ec9ada6deb9436d83dbb08cbda596b2 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:53.146154 9337 raft_consensus.cc:2258] T 2ec9ada6deb9436d83dbb08cbda596b2 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:53.147184 9337 ts_tablet_manager.cc:1905] T 2ec9ada6deb9436d83dbb08cbda596b2 P c0e6c57ab91e42bf9be3739c816916c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:53.165755 8914 tablet_service.cc:1514] Processing DeleteTablet for tablet d5cc68d7852940db88064e0ca35a7cba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:47:52 UTC) from {username='slave'} at 127.0.0.1:56452
I20260620 14:47:53.166115 9324 tablet_replica.cc:330] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4: stopping tablet replica
I20260620 14:47:53.166399 9324 raft_consensus.cc:2229] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:47:53.166661 9324 pending_rounds.cc:62] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4: Trying to abort 1 pending ops.
I20260620 14:47:53.166746 8914 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ec9ada6deb9436d83dbb08cbda596b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:47:52 UTC) from {username='slave'} at 127.0.0.1:56452
I20260620 14:47:53.166760 9324 pending_rounds.cc:68] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298936311904702464 op_type: NO_OP noop_request { }
I20260620 14:47:53.167083 9324 raft_consensus.cc:2866] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 14:47:53.167243 9324 raft_consensus.cc:2258] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:53.168300 9324 ts_tablet_manager.cc:1905] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:53.171075 9333 tablet_bootstrap.cc:492] T cfb843392987415ca86f344e28de15a5 P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:53.172811 9333 tablet_bootstrap.cc:654] T cfb843392987415ca86f344e28de15a5 P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:53.175895 9324 ts_tablet_manager.cc:1918] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:53.179620 9324 log.cc:1196] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal/wals/d5cc68d7852940db88064e0ca35a7cba
I20260620 14:47:53.180279 9324 ts_tablet_manager.cc:1939] T d5cc68d7852940db88064e0ca35a7cba P 6c99207e35f8463292d71c371c9546b4: Deleting consensus metadata
I20260620 14:47:53.184621 9337 ts_tablet_manager.cc:1918] T 2ec9ada6deb9436d83dbb08cbda596b2 P c0e6c57ab91e42bf9be3739c816916c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 14:47:53.184813 9337 log.cc:1196] T 2ec9ada6deb9436d83dbb08cbda596b2 P c0e6c57ab91e42bf9be3739c816916c0: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/wal/wals/2ec9ada6deb9436d83dbb08cbda596b2
I20260620 14:47:53.185223 9337 ts_tablet_manager.cc:1939] T 2ec9ada6deb9436d83dbb08cbda596b2 P c0e6c57ab91e42bf9be3739c816916c0: Deleting consensus metadata
I20260620 14:47:53.186129 9324 tablet_replica.cc:330] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4: stopping tablet replica
I20260620 14:47:53.186309 9138 catalog_manager.cc:4841] TS 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): tablet d5cc68d7852940db88064e0ca35a7cba (table default.table_1d0410429a7242ab85d16d800ffd0502 [id=15e21d8b3d5644f8ac2112c1dd37e7ff]) successfully deleted
I20260620 14:47:53.187485 9324 raft_consensus.cc:2229] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:47:53.188151 9324 pending_rounds.cc:62] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4: Trying to abort 1 pending ops.
I20260620 14:47:53.189658 8776 tablet_service.cc:1514] Processing DeleteTablet for tablet d5cc68d7852940db88064e0ca35a7cba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:47:52 UTC) from {username='slave'} at 127.0.0.1:49712
I20260620 14:47:53.189985 9326 tablet_replica.cc:330] T d5cc68d7852940db88064e0ca35a7cba P 36236dd5bd604ba2819038e525a3790c: stopping tablet replica
I20260620 14:47:53.190238 9326 raft_consensus.cc:2229] T d5cc68d7852940db88064e0ca35a7cba P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:53.190850 9326 raft_consensus.cc:2258] T d5cc68d7852940db88064e0ca35a7cba P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:53.191017 9324 pending_rounds.cc:68] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298936311660322816 op_type: NO_OP noop_request { }
I20260620 14:47:53.191207 9324 raft_consensus.cc:2866] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 14:47:53.191344 9324 raft_consensus.cc:2258] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:53.191852 9326 ts_tablet_manager.cc:1905] T d5cc68d7852940db88064e0ca35a7cba P 36236dd5bd604ba2819038e525a3790c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:53.192350 9324 ts_tablet_manager.cc:1905] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:53.194381 9162 catalog_manager.cc:2148] created HMS catalog entry for table [id=3b08ae3b47fd46cab8ef5a41bb0bc5d7]
I20260620 14:47:53.198136 9326 ts_tablet_manager.cc:1918] T d5cc68d7852940db88064e0ca35a7cba P 36236dd5bd604ba2819038e525a3790c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 14:47:53.202101 9324 ts_tablet_manager.cc:1918] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:53.202281 9324 log.cc:1196] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal/wals/2ec9ada6deb9436d83dbb08cbda596b2
I20260620 14:47:53.202842 9324 ts_tablet_manager.cc:1939] T 2ec9ada6deb9436d83dbb08cbda596b2 P 6c99207e35f8463292d71c371c9546b4: Deleting consensus metadata
I20260620 14:47:53.204182 9138 catalog_manager.cc:4841] TS 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): tablet 2ec9ada6deb9436d83dbb08cbda596b2 (table default.table_a800f01d336648a8b400cefc457c444d [id=ef56cde5526c4d9eacfbcd58922deed3]) successfully deleted
I20260620 14:47:53.210786 9326 log.cc:1196] T d5cc68d7852940db88064e0ca35a7cba P 36236dd5bd604ba2819038e525a3790c: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal/wals/d5cc68d7852940db88064e0ca35a7cba
I20260620 14:47:53.211213 9326 ts_tablet_manager.cc:1939] T d5cc68d7852940db88064e0ca35a7cba P 36236dd5bd604ba2819038e525a3790c: Deleting consensus metadata
I20260620 14:47:53.210433 9333 tablet_bootstrap.cc:492] T cfb843392987415ca86f344e28de15a5 P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:53.212231 9333 ts_tablet_manager.cc:1397] T cfb843392987415ca86f344e28de15a5 P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.041s user 0.005s sys 0.003s
I20260620 14:47:53.213089 9140 catalog_manager.cc:4841] TS 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): tablet d5cc68d7852940db88064e0ca35a7cba (table default.table_1d0410429a7242ab85d16d800ffd0502 [id=15e21d8b3d5644f8ac2112c1dd37e7ff]) successfully deleted
I20260620 14:47:53.213047 9333 raft_consensus.cc:348] T cfb843392987415ca86f344e28de15a5 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:53.213297 9333 raft_consensus.cc:374] T cfb843392987415ca86f344e28de15a5 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:53.213388 9333 raft_consensus.cc:729] T cfb843392987415ca86f344e28de15a5 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:53.213608 9333 consensus_queue.cc:260] T cfb843392987415ca86f344e28de15a5 P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:53.215831 9333 ts_tablet_manager.cc:1428] T cfb843392987415ca86f344e28de15a5 P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 14:47:53.216385 9228 consensus_queue.cc:1035] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:53.219954 8331 catalog_manager.cc:2158] deleted orphaned HMS catalog entry for table [id=a17882ca0acc459caae49f8238c7df14]
I20260620 14:47:53.220428 8331 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:59860 (request call id 28) took 3243 ms. Trace:
I20260620 14:47:53.220532 8331 rpcz_store.cc:276] 0620 14:47:49.977300 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:50.927699 (+950399us) service_pool.cc:227] Handling call
0620 14:47:52.425045 (+1497346us) catalog_manager.cc:2075] Acquired catalog manager lock
0620 14:47:52.425577 (+ 532us) catalog_manager.cc:2121] Created new table and tablet info
0620 14:47:52.507270 (+ 81693us) catalog_manager.cc:2147] Created new table in HMS catalog
0620 14:47:52.508402 (+ 1132us) write_op.cc:489] Releasing partition, row and schema locks
0620 14:47:52.508408 (+ 6us) write_op.cc:454] Released schema lock
0620 14:47:52.508717 (+ 309us) catalog_manager.cc:2155] Rolling back HMS table creation
0620 14:47:53.220357 (+711640us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 14:47:52.508279 (+ 0us) op_driver.cc:372] HandleFailure(Illegal state: replica dd308569015348a7a19ba4a560de6d52 is not leader of this config: current role FOLLOWER)
0620 14:47:52.508296 (+ 17us) write_op.cc:489] Releasing partition, row and schema locks
0620 14:47:52.508302 (+ 6us) write_op.cc:454] Released schema lock
0620 14:47:52.508305 (+ 3us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":618883,"Hive Metastore.run_cpu_time_us":465,"Hive Metastore.run_wall_time_us":173520,"child_traces":[["op",{}]]}
I20260620 14:47:53.223135 9328 tablet_bootstrap.cc:492] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:53.223280 9342 tablet_bootstrap.cc:492] T cfb843392987415ca86f344e28de15a5 P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:53.223299 9328 ts_tablet_manager.cc:1397] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.104s user 0.047s sys 0.016s
I20260620 14:47:53.223433 9342 ts_tablet_manager.cc:1397] T cfb843392987415ca86f344e28de15a5 P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.105s user 0.003s sys 0.006s
I20260620 14:47:53.223661 9138 catalog_manager.cc:4841] TS c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821): tablet 2ec9ada6deb9436d83dbb08cbda596b2 (table default.table_a800f01d336648a8b400cefc457c444d [id=ef56cde5526c4d9eacfbcd58922deed3]) successfully deleted
I20260620 14:47:53.224110 9328 raft_consensus.cc:348] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:53.224205 9342 raft_consensus.cc:348] T cfb843392987415ca86f344e28de15a5 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:53.224357 9328 raft_consensus.cc:374] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:53.224417 9342 raft_consensus.cc:374] T cfb843392987415ca86f344e28de15a5 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:53.224478 9328 raft_consensus.cc:729] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:53.224516 9342 raft_consensus.cc:729] T cfb843392987415ca86f344e28de15a5 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:53.224681 9328 consensus_queue.cc:260] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:53.224714 9342 consensus_queue.cc:260] T cfb843392987415ca86f344e28de15a5 P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:53.225503 9328 ts_tablet_manager.cc:1428] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 14:47:53.225776 9342 ts_tablet_manager.cc:1428] T cfb843392987415ca86f344e28de15a5 P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 14:47:53.228968 9062 raft_consensus.cc:482] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:53.229133 9062 raft_consensus.cc:504] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:53.229756 9062 leader_election.cc:288] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:53.230206 9062 consensus_queue.cc:1035] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:53.230302 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c60f9e1c724a3b99f6c25f7484fa7b" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:47:53.230576 8799 raft_consensus.cc:2454] T e4c60f9e1c724a3b99f6c25f7484fa7b P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:53.231114 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c60f9e1c724a3b99f6c25f7484fa7b" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:47:53.231374 8659 raft_consensus.cc:2454] T e4c60f9e1c724a3b99f6c25f7484fa7b P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:53.231734 8871 leader_election.cc:302] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4; no voters:
I20260620 14:47:53.232800 9234 raft_consensus.cc:2781] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:53.232916 9234 raft_consensus.cc:482] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:53.233017 9234 raft_consensus.cc:3037] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:53.234237 8776 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ec9ada6deb9436d83dbb08cbda596b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:47:52 UTC) from {username='slave'} at 127.0.0.1:49712
I20260620 14:47:53.235742 9234 raft_consensus.cc:504] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:53.238808 9326 tablet_replica.cc:330] T 2ec9ada6deb9436d83dbb08cbda596b2 P 36236dd5bd604ba2819038e525a3790c: stopping tablet replica
I20260620 14:47:53.240084 9326 raft_consensus.cc:2229] T 2ec9ada6deb9436d83dbb08cbda596b2 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:53.240322 9326 raft_consensus.cc:2258] T 2ec9ada6deb9436d83dbb08cbda596b2 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:53.244853 9234 leader_election.cc:288] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Requested vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:53.245467 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c60f9e1c724a3b99f6c25f7484fa7b" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:47:53.245659 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c60f9e1c724a3b99f6c25f7484fa7b" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:47:53.245886 8659 raft_consensus.cc:3037] T e4c60f9e1c724a3b99f6c25f7484fa7b P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:53.246223 8799 raft_consensus.cc:3037] T e4c60f9e1c724a3b99f6c25f7484fa7b P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:53.247673 9162 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38546:
table { table_name: "default.Table_e8372b71bacb4865b4360a50af59d323" } new_table_name: "default.Table_0397b5018c12412d8adff6a6eef71ab4" modify_external_catalogs: true
I20260620 14:47:53.248850 8799 raft_consensus.cc:2454] T e4c60f9e1c724a3b99f6c25f7484fa7b P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:53.248850 8659 raft_consensus.cc:2454] T e4c60f9e1c724a3b99f6c25f7484fa7b P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:53.246078 9326 ts_tablet_manager.cc:1905] T 2ec9ada6deb9436d83dbb08cbda596b2 P 36236dd5bd604ba2819038e525a3790c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:53.249354 8869 leader_election.cc:302] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:53.249830 8914 tablet_service.cc:1467] Processing CreateTablet for tablet 77320ec0783e43c2817b0ff16134915e (DEFAULT_TABLE table=default.table_154fc524efb24453bdb6d735e4c741e9 [id=3b08ae3b47fd46cab8ef5a41bb0bc5d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:53.250183 9234 raft_consensus.cc:2781] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:53.250296 8914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77320ec0783e43c2817b0ff16134915e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:53.250355 9234 raft_consensus.cc:686] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Becoming Leader. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Running, Role: LEADER
I20260620 14:47:53.250577 9234 consensus_queue.cc:237] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:53.253228 8638 tablet_service.cc:1467] Processing CreateTablet for tablet 77320ec0783e43c2817b0ff16134915e (DEFAULT_TABLE table=default.table_154fc524efb24453bdb6d735e4c741e9 [id=3b08ae3b47fd46cab8ef5a41bb0bc5d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:53.253775 8638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77320ec0783e43c2817b0ff16134915e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:53.256112 9326 ts_tablet_manager.cc:1918] T 2ec9ada6deb9436d83dbb08cbda596b2 P 36236dd5bd604ba2819038e525a3790c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 14:47:53.256273 9326 log.cc:1196] T 2ec9ada6deb9436d83dbb08cbda596b2 P 36236dd5bd604ba2819038e525a3790c: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal/wals/2ec9ada6deb9436d83dbb08cbda596b2
I20260620 14:47:53.256645 9326 ts_tablet_manager.cc:1939] T 2ec9ada6deb9436d83dbb08cbda596b2 P 36236dd5bd604ba2819038e525a3790c: Deleting consensus metadata
I20260620 14:47:53.258421 8776 tablet_service.cc:1467] Processing CreateTablet for tablet 77320ec0783e43c2817b0ff16134915e (DEFAULT_TABLE table=default.table_154fc524efb24453bdb6d735e4c741e9 [id=3b08ae3b47fd46cab8ef5a41bb0bc5d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:53.258823 8776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77320ec0783e43c2817b0ff16134915e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:53.264189 9140 catalog_manager.cc:4841] TS 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): tablet 2ec9ada6deb9436d83dbb08cbda596b2 (table default.table_a800f01d336648a8b400cefc457c444d [id=ef56cde5526c4d9eacfbcd58922deed3]) successfully deleted
I20260620 14:47:53.272369 9164 catalog_manager.cc:5495] T c4e5daabb2954a6f955fd4857b362884 P 6c99207e35f8463292d71c371c9546b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c99207e35f8463292d71c371c9546b4 (127.7.222.195). New cstate: current_term: 1 leader_uuid: "6c99207e35f8463292d71c371c9546b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } health_report { overall_health: UNKNOWN } } }
I20260620 14:47:53.275090 9342 tablet_bootstrap.cc:492] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:53.277137 9342 tablet_bootstrap.cc:654] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:53.279498 9328 tablet_bootstrap.cc:492] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:53.279595 9333 tablet_bootstrap.cc:492] T 77320ec0783e43c2817b0ff16134915e P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:53.281225 9333 tablet_bootstrap.cc:654] T 77320ec0783e43c2817b0ff16134915e P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:53.281280 9328 tablet_bootstrap.cc:654] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:53.294081 9164 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38546:
table { table_name: "default.Table_1ea7c21a49a443c29bd5578c5950c27f" } new_table_name: "default.Table_2b02aaacb2204d27a2fa683065bccc6b" modify_external_catalogs: true
I20260620 14:47:53.296051 9333 tablet_bootstrap.cc:492] T 77320ec0783e43c2817b0ff16134915e P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:53.296288 9333 ts_tablet_manager.cc:1397] T 77320ec0783e43c2817b0ff16134915e P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.005s
I20260620 14:47:53.297086 9333 raft_consensus.cc:348] T 77320ec0783e43c2817b0ff16134915e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:53.297344 9333 raft_consensus.cc:374] T 77320ec0783e43c2817b0ff16134915e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:53.297420 9333 raft_consensus.cc:729] T 77320ec0783e43c2817b0ff16134915e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:53.298278 9328 tablet_bootstrap.cc:492] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:53.298345 8914 tablet_service.cc:1514] Processing DeleteTablet for tablet d5cc68d7852940db88064e0ca35a7cba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:47:52 UTC) from {username='slave'} at 127.0.0.1:56452
I20260620 14:47:53.298448 9328 ts_tablet_manager.cc:1397] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.012s
I20260620 14:47:53.299139 9328 raft_consensus.cc:348] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:53.299366 9328 raft_consensus.cc:374] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:53.299451 9328 raft_consensus.cc:729] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:53.299654 9328 consensus_queue.cc:260] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:53.300366 9328 ts_tablet_manager.cc:1428] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260620 14:47:53.300805 9333 consensus_queue.cc:260] T 77320ec0783e43c2817b0ff16134915e P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:53.301515 9333 ts_tablet_manager.cc:1428] T 77320ec0783e43c2817b0ff16134915e P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
W20260620 14:47:53.302663 9138 catalog_manager.cc:4808] TS 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): delete failed for tablet d5cc68d7852940db88064e0ca35a7cba because the tablet was not found. No further retry: Not found: Tablet not found: d5cc68d7852940db88064e0ca35a7cba
I20260620 14:47:53.312028 9342 tablet_bootstrap.cc:492] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:53.312230 9342 ts_tablet_manager.cc:1397] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.037s user 0.007s sys 0.008s
I20260620 14:47:53.312958 9342 raft_consensus.cc:348] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:53.313186 9342 raft_consensus.cc:374] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:53.313282 9342 raft_consensus.cc:729] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:53.313544 9342 consensus_queue.cc:260] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:53.314117 9342 ts_tablet_manager.cc:1428] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 14:47:53.340992 8326 catalog_manager.cc:2158] deleted orphaned HMS catalog entry for table [id=dd35f6770b3f4a91b60918c68c38b8a5]
I20260620 14:47:53.341449 8326 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:59860 (request call id 33) took 3191 ms. Trace:
I20260620 14:47:53.341573 8326 rpcz_store.cc:276] 0620 14:47:50.149959 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:51.656167 (+1506208us) service_pool.cc:227] Handling call
0620 14:47:52.435797 (+779630us) catalog_manager.cc:2075] Acquired catalog manager lock
0620 14:47:52.436266 (+ 469us) catalog_manager.cc:2121] Created new table and tablet info
0620 14:47:52.904493 (+468227us) catalog_manager.cc:2147] Created new table in HMS catalog
0620 14:47:52.905302 (+ 809us) write_op.cc:489] Releasing partition, row and schema locks
0620 14:47:52.905305 (+ 3us) write_op.cc:454] Released schema lock
0620 14:47:52.905591 (+ 286us) catalog_manager.cc:2155] Rolling back HMS table creation
0620 14:47:53.341408 (+435817us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 14:47:52.905223 (+ 0us) op_driver.cc:372] HandleFailure(Illegal state: replica dd308569015348a7a19ba4a560de6d52 is not leader of this config: current role FOLLOWER)
0620 14:47:52.905235 (+ 12us) write_op.cc:489] Releasing partition, row and schema locks
0620 14:47:52.905244 (+ 9us) write_op.cc:454] Released schema lock
0620 14:47:52.905249 (+ 5us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":536221,"Hive Metastore.run_cpu_time_us":534,"Hive Metastore.run_wall_time_us":366856,"child_traces":[["op",{}]]}
I20260620 14:47:53.362746 9166 catalog_manager.cc:2685] deleted HMS catalog entry for table default.table_0eb776233cee4294b6c96ec556447663 [id=3420fc1c9c8b45f49aeaa7b4c97da51e]
I20260620 14:47:53.404179 9160 catalog_manager.cc:3411] renamed table default.table_19c624001d444b7b9939e22128c594aa [id=98d2e7b647544a97b50827a0cb2799a0] in HMS: new name default.table_ed65359dea1b47aab601b55d6957c2dd
I20260620 14:47:53.408555 9225 catalog_manager.cc:2709] Deleting table default.table_7f82e63c368b415ca9ea3cd201986de1 [id=7f9c4b4af7614d20b0e5ddfbf7d2b0f5] in response to Hive Metastore notification log event 25
I20260620 14:47:53.422749 9225 catalog_manager.cc:5782] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Sending DeleteTablet for 3 replicas of tablet e4c60f9e1c724a3b99f6c25f7484fa7b
I20260620 14:47:53.423506 8914 tablet_service.cc:1514] Processing DeleteTablet for tablet e4c60f9e1c724a3b99f6c25f7484fa7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:47:53 UTC) from {username='slave'} at 127.0.0.1:56452
I20260620 14:47:53.423846 9324 tablet_replica.cc:330] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4: stopping tablet replica
I20260620 14:47:53.424518 9324 raft_consensus.cc:2229] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:47:53.424889 9324 pending_rounds.cc:62] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4: Trying to abort 1 pending ops.
I20260620 14:47:53.424986 9324 pending_rounds.cc:68] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298936312837963776 op_type: NO_OP noop_request { }
I20260620 14:47:53.425143 9324 raft_consensus.cc:2866] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 14:47:53.425276 9324 raft_consensus.cc:2258] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:53.426225 8638 tablet_service.cc:1514] Processing DeleteTablet for tablet e4c60f9e1c724a3b99f6c25f7484fa7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:47:53 UTC) from {username='slave'} at 127.0.0.1:52288
I20260620 14:47:53.426556 9337 tablet_replica.cc:330] T e4c60f9e1c724a3b99f6c25f7484fa7b P c0e6c57ab91e42bf9be3739c816916c0: stopping tablet replica
I20260620 14:47:53.426777 9225 catalog_manager.cc:2709] Deleting table default.table_de1c78a84d1349dea4d9e9d032a258be [id=a78802b888ed44b5b439381a6890a67d] in response to Hive Metastore notification log event 27
I20260620 14:47:53.426790 9337 raft_consensus.cc:2229] T e4c60f9e1c724a3b99f6c25f7484fa7b P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:53.426982 9337 raft_consensus.cc:2258] T e4c60f9e1c724a3b99f6c25f7484fa7b P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:53.427615 9337 ts_tablet_manager.cc:1905] T e4c60f9e1c724a3b99f6c25f7484fa7b P c0e6c57ab91e42bf9be3739c816916c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:53.429356 8776 tablet_service.cc:1514] Processing DeleteTablet for tablet e4c60f9e1c724a3b99f6c25f7484fa7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:47:53 UTC) from {username='slave'} at 127.0.0.1:49712
I20260620 14:47:53.429639 9326 tablet_replica.cc:330] T e4c60f9e1c724a3b99f6c25f7484fa7b P 36236dd5bd604ba2819038e525a3790c: stopping tablet replica
I20260620 14:47:53.429863 9326 raft_consensus.cc:2229] T e4c60f9e1c724a3b99f6c25f7484fa7b P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:53.430042 9326 raft_consensus.cc:2258] T e4c60f9e1c724a3b99f6c25f7484fa7b P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:53.430631 9326 ts_tablet_manager.cc:1905] T e4c60f9e1c724a3b99f6c25f7484fa7b P 36236dd5bd604ba2819038e525a3790c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:53.432453 9234 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:53.432606 9234 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:53.433312 9234 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:53.433799 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77320ec0783e43c2817b0ff16134915e" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:47:53.434020 8659 raft_consensus.cc:2454] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:53.434024 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77320ec0783e43c2817b0ff16134915e" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:47:53.434268 8799 raft_consensus.cc:2454] T 77320ec0783e43c2817b0ff16134915e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:53.434603 8869 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:53.435855 9234 raft_consensus.cc:2781] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:53.435963 9234 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:53.436039 9234 raft_consensus.cc:3037] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:53.436792 9326 ts_tablet_manager.cc:1918] T e4c60f9e1c724a3b99f6c25f7484fa7b P 36236dd5bd604ba2819038e525a3790c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 14:47:53.436918 9326 log.cc:1196] T e4c60f9e1c724a3b99f6c25f7484fa7b P 36236dd5bd604ba2819038e525a3790c: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal/wals/e4c60f9e1c724a3b99f6c25f7484fa7b
I20260620 14:47:53.437234 9326 ts_tablet_manager.cc:1939] T e4c60f9e1c724a3b99f6c25f7484fa7b P 36236dd5bd604ba2819038e525a3790c: Deleting consensus metadata
I20260620 14:47:53.438338 9140 catalog_manager.cc:4841] TS 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): tablet e4c60f9e1c724a3b99f6c25f7484fa7b (table default.table_7f82e63c368b415ca9ea3cd201986de1 [id=7f9c4b4af7614d20b0e5ddfbf7d2b0f5]) successfully deleted
I20260620 14:47:53.439188 9234 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:53.440323 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77320ec0783e43c2817b0ff16134915e" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:47:53.440320 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77320ec0783e43c2817b0ff16134915e" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:47:53.440518 8799 raft_consensus.cc:3037] T 77320ec0783e43c2817b0ff16134915e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:53.440534 8659 raft_consensus.cc:3037] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:53.440557 9168 catalog_manager.cc:2148] created HMS catalog entry for table [id=7e71694fb4a948f09c01863575227fda]
I20260620 14:47:53.443187 8659 raft_consensus.cc:2454] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:53.443804 8869 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:53.444103 9228 raft_consensus.cc:2781] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:53.444221 9228 raft_consensus.cc:686] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Becoming Leader. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Running, Role: LEADER
I20260620 14:47:53.444435 8799 raft_consensus.cc:2454] T 77320ec0783e43c2817b0ff16134915e P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:53.444495 9228 consensus_queue.cc:237] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:53.447077 9324 ts_tablet_manager.cc:1905] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:53.459623 9168 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38546:
table { table_name: "default.Table_a901d915c377429a9e43cfcaf071e7d3" } modify_external_catalogs: true
I20260620 14:47:53.462131 9168 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38546:
table { table_name: "default.Table_a901d915c377429a9e43cfcaf071e7d3" } modify_external_catalogs: true
I20260620 14:47:53.471951 9225 catalog_manager.cc:5782] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Sending DeleteTablet for 3 replicas of tablet 3a85749745a7440fb637d4918de5f798
I20260620 14:47:53.472806 8638 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a85749745a7440fb637d4918de5f798 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:47:53 UTC) from {username='slave'} at 127.0.0.1:52288
I20260620 14:47:53.473990 9225 catalog_manager.cc:2709] Deleting table default.table_2d00c2dfdbfe428a8de80587e6f6e918 [id=a17882ca0acc459caae49f8238c7df14] in response to Hive Metastore notification log event 28
W20260620 14:47:53.474315 9225 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 28 DROP_TABLE default.table_2d00c2dfdbfe428a8de80587e6f6e918: Not found: the table does not exist: table_id: "a17882ca0acc459caae49f8238c7df14" table_name: "default.table_2d00c2dfdbfe428a8de80587e6f6e918"
F20260620 14:47:53.474414 9225 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 28): 28 CREATE_TABLE default.table_154fc524efb24453bdb6d735e4c741e9
*** Check failure stack trace: ***
@ 0x7f4374d509ad google::LogMessage::Fail() at ??:0
I20260620 14:47:53.477372 8914 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a85749745a7440fb637d4918de5f798 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:47:53 UTC) from {username='slave'} at 127.0.0.1:56452
I20260620 14:47:53.477955 8776 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a85749745a7440fb637d4918de5f798 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-20 14:47:53 UTC) from {username='slave'} at 127.0.0.1:49712
I20260620 14:47:53.478264 9326 tablet_replica.cc:330] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c: stopping tablet replica
I20260620 14:47:53.478488 9326 raft_consensus.cc:2229] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:47:53.478838 9326 raft_consensus.cc:2258] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:53.479476 9326 ts_tablet_manager.cc:1905] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:53.484814 8776 tablet_service.cc:1467] Processing CreateTablet for tablet 309a0915648643ada08981a11e7a1e59 (DEFAULT_TABLE table=default.table_563392802bec4e688c0eabd46ab1fd5c [id=7e71694fb4a948f09c01863575227fda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:53.485399 8638 tablet_service.cc:1467] Processing CreateTablet for tablet 309a0915648643ada08981a11e7a1e59 (DEFAULT_TABLE table=default.table_563392802bec4e688c0eabd46ab1fd5c [id=7e71694fb4a948f09c01863575227fda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:53.485819 8638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 309a0915648643ada08981a11e7a1e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:53.488334 9234 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Requested vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:53.489468 8914 tablet_service.cc:1467] Processing CreateTablet for tablet 309a0915648643ada08981a11e7a1e59 (DEFAULT_TABLE table=default.table_563392802bec4e688c0eabd46ab1fd5c [id=7e71694fb4a948f09c01863575227fda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:53.489916 8914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 309a0915648643ada08981a11e7a1e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:53.491425 9337 ts_tablet_manager.cc:1918] T e4c60f9e1c724a3b99f6c25f7484fa7b P c0e6c57ab91e42bf9be3739c816916c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260620 14:47:53.491565 9337 log.cc:1196] T e4c60f9e1c724a3b99f6c25f7484fa7b P c0e6c57ab91e42bf9be3739c816916c0: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/wal/wals/e4c60f9e1c724a3b99f6c25f7484fa7b
I20260620 14:47:53.491899 9337 ts_tablet_manager.cc:1939] T e4c60f9e1c724a3b99f6c25f7484fa7b P c0e6c57ab91e42bf9be3739c816916c0: Deleting consensus metadata
I20260620 14:47:53.492869 9337 tablet_replica.cc:330] T 3a85749745a7440fb637d4918de5f798 P c0e6c57ab91e42bf9be3739c816916c0: stopping tablet replica
I20260620 14:47:53.493052 9337 raft_consensus.cc:2229] T 3a85749745a7440fb637d4918de5f798 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:53.493238 9337 raft_consensus.cc:2258] T 3a85749745a7440fb637d4918de5f798 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:53.493782 9337 ts_tablet_manager.cc:1905] T 3a85749745a7440fb637d4918de5f798 P c0e6c57ab91e42bf9be3739c816916c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:53.493978 8776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 309a0915648643ada08981a11e7a1e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:53.497073 9138 catalog_manager.cc:4841] TS c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821): tablet e4c60f9e1c724a3b99f6c25f7484fa7b (table default.table_7f82e63c368b415ca9ea3cd201986de1 [id=7f9c4b4af7614d20b0e5ddfbf7d2b0f5]) successfully deleted
I20260620 14:47:53.500836 9324 ts_tablet_manager.cc:1918] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:53.500974 9324 log.cc:1196] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal/wals/e4c60f9e1c724a3b99f6c25f7484fa7b
I20260620 14:47:53.501420 9324 ts_tablet_manager.cc:1939] T e4c60f9e1c724a3b99f6c25f7484fa7b P 6c99207e35f8463292d71c371c9546b4: Deleting consensus metadata
I20260620 14:47:53.502427 9138 catalog_manager.cc:4841] TS 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): tablet e4c60f9e1c724a3b99f6c25f7484fa7b (table default.table_7f82e63c368b415ca9ea3cd201986de1 [id=7f9c4b4af7614d20b0e5ddfbf7d2b0f5]) successfully deleted
@ 0x7f4374d5388a google::LogMessage::SendToLog() at ??:0
@ 0x7f4374d504de google::LogMessage::Flush() at ??:0
@ 0x7f4374d506d1 google::LogMessage::~LogMessage() at ??:0
I20260620 14:47:53.510943 9228 raft_consensus.cc:482] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:53.511139 9228 raft_consensus.cc:504] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:53.511760 9228 leader_election.cc:288] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:53.512864 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb843392987415ca86f344e28de15a5" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:47:53.513113 8659 raft_consensus.cc:2454] T cfb843392987415ca86f344e28de15a5 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:53.513523 8869 leader_election.cc:302] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:53.513796 9228 raft_consensus.cc:2781] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:53.513870 9228 raft_consensus.cc:482] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:53.513968 9228 raft_consensus.cc:3037] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:53.514266 9337 ts_tablet_manager.cc:1918] T 3a85749745a7440fb637d4918de5f798 P c0e6c57ab91e42bf9be3739c816916c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:53.514380 9337 log.cc:1196] T 3a85749745a7440fb637d4918de5f798 P c0e6c57ab91e42bf9be3739c816916c0: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/wal/wals/3a85749745a7440fb637d4918de5f798
I20260620 14:47:53.514796 9337 ts_tablet_manager.cc:1939] T 3a85749745a7440fb637d4918de5f798 P c0e6c57ab91e42bf9be3739c816916c0: Deleting consensus metadata
I20260620 14:47:53.515772 9324 tablet_replica.cc:330] T 3a85749745a7440fb637d4918de5f798 P 6c99207e35f8463292d71c371c9546b4: stopping tablet replica
I20260620 14:47:53.515981 9324 raft_consensus.cc:2229] T 3a85749745a7440fb637d4918de5f798 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:53.516140 9324 raft_consensus.cc:2258] T 3a85749745a7440fb637d4918de5f798 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:53.516734 9324 ts_tablet_manager.cc:1905] T 3a85749745a7440fb637d4918de5f798 P 6c99207e35f8463292d71c371c9546b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:53.517091 9138 catalog_manager.cc:4841] TS c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821): tablet 3a85749745a7440fb637d4918de5f798 (table default.table_de1c78a84d1349dea4d9e9d032a258be [id=a78802b888ed44b5b439381a6890a67d]) successfully deleted
I20260620 14:47:53.517525 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb843392987415ca86f344e28de15a5" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:47:53.517808 8799 raft_consensus.cc:2454] T cfb843392987415ca86f344e28de15a5 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:53.516636 9228 raft_consensus.cc:504] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:53.519371 9228 leader_election.cc:288] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Requested vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:53.519925 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb843392987415ca86f344e28de15a5" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:47:53.520154 8659 raft_consensus.cc:3037] T cfb843392987415ca86f344e28de15a5 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:53.521764 8059 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task9VKlbC/build/asan/bin/kudu pid 9083
I20260620 14:47:53.522993 8659 raft_consensus.cc:2454] T cfb843392987415ca86f344e28de15a5 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:53.523586 8869 leader_election.cc:302] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:53.523999 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb843392987415ca86f344e28de15a5" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:47:53.524284 8799 raft_consensus.cc:3037] T cfb843392987415ca86f344e28de15a5 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:53.528141 9062 raft_consensus.cc:2781] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:53.528302 9062 raft_consensus.cc:686] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Becoming Leader. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Running, Role: LEADER
I20260620 14:47:53.528591 9062 consensus_queue.cc:237] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:53.539825 9161 catalog_manager.cc:2148] created HMS catalog entry for table [id=ddb41391569b4a11b4ad85335ca24ddb]
I20260620 14:47:53.546370 9161 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:38546 (request call id 10) took 1087 ms. Trace:
I20260620 14:47:53.547528 9333 tablet_bootstrap.cc:492] T 309a0915648643ada08981a11e7a1e59 P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:53.549223 9333 tablet_bootstrap.cc:654] T 309a0915648643ada08981a11e7a1e59 P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:53.556846 8913 tablet_service.cc:1467] Processing CreateTablet for tablet 7a78d61e26c645b6bd82b6070c677b98 (DEFAULT_TABLE table=default.table_d2959bb621be429eb5af827263887798 [id=ddb41391569b4a11b4ad85335ca24ddb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:53.557305 8913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a78d61e26c645b6bd82b6070c677b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:53.560789 9169 catalog_manager.cc:2148] created HMS catalog entry for table [id=76fec3007aa94f71867761f887e9b73e]
I20260620 14:47:53.562338 8637 tablet_service.cc:1467] Processing CreateTablet for tablet 7a78d61e26c645b6bd82b6070c677b98 (DEFAULT_TABLE table=default.table_d2959bb621be429eb5af827263887798 [id=ddb41391569b4a11b4ad85335ca24ddb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:53.562832 8637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a78d61e26c645b6bd82b6070c677b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:53.567235 9169 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:38546 (request call id 15) took 1107 ms. Trace:
I20260620 14:47:53.546511 9161 rpcz_store.cc:276] 0620 14:47:52.459063 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:52.535314 (+ 76251us) service_pool.cc:227] Handling call
0620 14:47:52.546486 (+ 11172us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x6150000409a4. stack: 00007f437795666e 00007f4377956430 00007f43769dd5ed 00000000008ea064 00000000008ea02d 00007f438606f27d 00007f438606f373 00007f4382e91361 00007f438a80466a 00007f438a98c313 00007f4381c7e466 00007f4381c7e195 00007f437e4929be 00007f437e49179e 00007f437e497b25 00007f437e49854f
0620 14:47:52.665115 (+118629us) catalog_manager.cc:2075] Acquired catalog manager lock
0620 14:47:52.665508 (+ 393us) catalog_manager.cc:2121] Created new table and tablet info
0620 14:47:53.539783 (+874275us) catalog_manager.cc:2147] Created new table in HMS catalog
0620 14:47:53.546102 (+ 6319us) catalog_manager.cc:2181] Wrote table and tablets to system table
0620 14:47:53.546213 (+ 111us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0620 14:47:53.546309 (+ 96us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 14:47:53.540640 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 14:47:53.540818 (+ 178us) write_op.cc:432] Acquiring schema lock in shared mode
0620 14:47:53.540825 (+ 7us) write_op.cc:435] Acquired schema lock
0620 14:47:53.540828 (+ 3us) tablet.cc:660] Decoding operations
0620 14:47:53.540933 (+ 105us) write_op.cc:620] Acquiring the partition lock for write op
0620 14:47:53.540948 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0620 14:47:53.540953 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0620 14:47:53.541045 (+ 92us) tablet.cc:699] Row locks acquired
0620 14:47:53.541048 (+ 3us) write_op.cc:260] PREPARE: finished
0620 14:47:53.541091 (+ 43us) write_op.cc:270] Start()
0620 14:47:53.541129 (+ 38us) write_op.cc:276] Timestamp: P: 1781966873541046 usec, L: 0
0620 14:47:53.541132 (+ 3us) op_driver.cc:331] REPLICATION: starting
0620 14:47:53.541327 (+ 195us) log.cc:842] Serialized 432 byte log entry
0620 14:47:53.545425 (+ 4098us) op_driver.cc:444] REPLICATION: finished
0620 14:47:53.545527 (+ 102us) write_op.cc:301] APPLY: starting
0620 14:47:53.545544 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
0620 14:47:53.545600 (+ 56us) tablet.cc:1368] finished BulkCheckPresence
0620 14:47:53.545633 (+ 33us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 14:47:53.545744 (+ 111us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 14:47:53.545781 (+ 37us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0620 14:47:53.545788 (+ 7us) write_op.cc:312] APPLY: finished
0620 14:47:53.545858 (+ 70us) log.cc:842] Serialized 28 byte log entry
0620 14:47:53.545916 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0620 14:47:53.545939 (+ 23us) write_op.cc:454] Released schema lock
0620 14:47:53.545945 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0620 14:47:53.545996 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0620 14:47:53.545999 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":774694,"Hive Metastore.run_cpu_time_us":299,"Hive Metastore.run_wall_time_us":99200,"spinlock_wait_cycles":24862464,"child_traces":[["op",{"apply.queue_time_us":55,"apply.run_cpu_time_us":520,"apply.run_wall_time_us":520,"num_ops":2,"prepare.queue_time_us":54,"prepare.run_cpu_time_us":806,"prepare.run_wall_time_us":806,"raft.queue_time_us":1174,"raft.run_cpu_time_us":476,"raft.run_wall_time_us":475,"replication_time_us":4269}]]}
I20260620 14:47:53.567350 9169 rpcz_store.cc:276] 0620 14:47:52.459704 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:52.618269 (+158565us) service_pool.cc:227] Handling call
0620 14:47:52.665638 (+ 47369us) catalog_manager.cc:2075] Acquired catalog manager lock
0620 14:47:52.666038 (+ 400us) catalog_manager.cc:2121] Created new table and tablet info
0620 14:47:53.560726 (+894688us) catalog_manager.cc:2147] Created new table in HMS catalog
0620 14:47:53.566937 (+ 6211us) catalog_manager.cc:2181] Wrote table and tablets to system table
0620 14:47:53.567060 (+ 123us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0620 14:47:53.567169 (+ 109us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 14:47:53.561604 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 14:47:53.561730 (+ 126us) write_op.cc:432] Acquiring schema lock in shared mode
0620 14:47:53.561735 (+ 5us) write_op.cc:435] Acquired schema lock
0620 14:47:53.561738 (+ 3us) tablet.cc:660] Decoding operations
0620 14:47:53.561840 (+ 102us) write_op.cc:620] Acquiring the partition lock for write op
0620 14:47:53.561858 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0620 14:47:53.561862 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
0620 14:47:53.561963 (+ 101us) tablet.cc:699] Row locks acquired
0620 14:47:53.561965 (+ 2us) write_op.cc:260] PREPARE: finished
0620 14:47:53.562026 (+ 61us) write_op.cc:270] Start()
0620 14:47:53.562063 (+ 37us) write_op.cc:276] Timestamp: P: 1781966873561976 usec, L: 0
0620 14:47:53.562067 (+ 4us) op_driver.cc:331] REPLICATION: starting
0620 14:47:53.562274 (+ 207us) log.cc:842] Serialized 432 byte log entry
0620 14:47:53.565886 (+ 3612us) op_driver.cc:444] REPLICATION: finished
0620 14:47:53.566021 (+ 135us) write_op.cc:301] APPLY: starting
0620 14:47:53.566037 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
0620 14:47:53.566081 (+ 44us) tablet.cc:1368] finished BulkCheckPresence
0620 14:47:53.566118 (+ 37us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 14:47:53.566222 (+ 104us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 14:47:53.566258 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0620 14:47:53.566266 (+ 8us) write_op.cc:312] APPLY: finished
0620 14:47:53.566741 (+ 475us) log.cc:842] Serialized 28 byte log entry
0620 14:47:53.566818 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0620 14:47:53.566839 (+ 21us) write_op.cc:454] Released schema lock
0620 14:47:53.566847 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0620 14:47:53.566916 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0620 14:47:53.566922 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":873427,"Hive Metastore.run_cpu_time_us":274,"Hive Metastore.run_wall_time_us":21110,"child_traces":[["op",{"apply.queue_time_us":86,"apply.run_cpu_time_us":954,"apply.run_wall_time_us":954,"num_ops":2,"prepare.queue_time_us":69,"prepare.run_cpu_time_us":798,"prepare.run_wall_time_us":798,"raft.queue_time_us":426,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":252,"replication_time_us":3792}]]}
I20260620 14:47:53.571635 9342 tablet_bootstrap.cc:492] T 7a78d61e26c645b6bd82b6070c677b98 P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:53.573578 9342 tablet_bootstrap.cc:654] T 7a78d61e26c645b6bd82b6070c677b98 P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:53.574718 9324 ts_tablet_manager.cc:1918] T 3a85749745a7440fb637d4918de5f798 P 6c99207e35f8463292d71c371c9546b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:53.574923 9324 log.cc:1196] T 3a85749745a7440fb637d4918de5f798 P 6c99207e35f8463292d71c371c9546b4: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal/wals/3a85749745a7440fb637d4918de5f798
I20260620 14:47:53.575417 9324 ts_tablet_manager.cc:1939] T 3a85749745a7440fb637d4918de5f798 P 6c99207e35f8463292d71c371c9546b4: Deleting consensus metadata
I20260620 14:47:53.578715 9328 tablet_bootstrap.cc:492] T 309a0915648643ada08981a11e7a1e59 P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:53.580487 9328 tablet_bootstrap.cc:654] T 309a0915648643ada08981a11e7a1e59 P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:53.582815 8799 raft_consensus.cc:2454] T cfb843392987415ca86f344e28de15a5 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:53.584843 9169 catalog_manager.cc:5495] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c99207e35f8463292d71c371c9546b4 (127.7.222.195). New cstate: current_term: 1 leader_uuid: "6c99207e35f8463292d71c371c9546b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } health_report { overall_health: UNKNOWN } } }
I20260620 14:47:53.587357 9326 ts_tablet_manager.cc:1918] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:53.587532 9326 log.cc:1196] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal/wals/3a85749745a7440fb637d4918de5f798
I20260620 14:47:53.588167 9326 ts_tablet_manager.cc:1939] T 3a85749745a7440fb637d4918de5f798 P 36236dd5bd604ba2819038e525a3790c: Deleting consensus metadata
I20260620 14:47:53.590811 8913 tablet_service.cc:1467] Processing CreateTablet for tablet 73a17f00358f415d8b72a53859963eac (DEFAULT_TABLE table=default.table_7911231c2bcb420ebe8f3e12604c29e4 [id=76fec3007aa94f71867761f887e9b73e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:53.591243 8913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73a17f00358f415d8b72a53859963eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:53.594518 8638 tablet_service.cc:1467] Processing CreateTablet for tablet 73a17f00358f415d8b72a53859963eac (DEFAULT_TABLE table=default.table_7911231c2bcb420ebe8f3e12604c29e4 [id=76fec3007aa94f71867761f887e9b73e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:53.595152 8638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73a17f00358f415d8b72a53859963eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:53.595701 9161 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38546:
table { table_name: "default.Table_98318448fcf3484cb76812dad2975098" } new_table_name: "default.Table_b4a1333c5cb24d1093488dce20083354" modify_external_catalogs: true
I20260620 14:47:53.599526 9169 master_service.cc:946] ReplaceTablet: received request to replace tablet c33a5b17df824c0ab066dee1fa610906 from {username='slave'} at 127.0.0.1:38546
W20260620 14:47:53.607689 8871 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.222.194:39159, user_credentials={real_user=slave}} blocked reactor thread for 75653.6us
I20260620 14:47:53.608655 9169 catalog_manager.cc:5782] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Sending DeleteTablet for 3 replicas of tablet c33a5b17df824c0ab066dee1fa610906
I20260620 14:47:53.609369 8637 tablet_service.cc:1514] Processing DeleteTablet for tablet c33a5b17df824c0ab066dee1fa610906 with delete_type TABLET_DATA_DELETED (replaced by tablet 2b45f60882664099b090170903fe74b2) from {username='slave'} at 127.0.0.1:52288
I20260620 14:47:53.609799 9337 tablet_replica.cc:330] T c33a5b17df824c0ab066dee1fa610906 P c0e6c57ab91e42bf9be3739c816916c0: stopping tablet replica
I20260620 14:47:53.610402 9337 raft_consensus.cc:2229] T c33a5b17df824c0ab066dee1fa610906 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:53.610602 9337 raft_consensus.cc:2258] T c33a5b17df824c0ab066dee1fa610906 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:53.611212 9337 ts_tablet_manager.cc:1905] T c33a5b17df824c0ab066dee1fa610906 P c0e6c57ab91e42bf9be3739c816916c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:53.612932 8914 tablet_service.cc:1514] Processing DeleteTablet for tablet c33a5b17df824c0ab066dee1fa610906 with delete_type TABLET_DATA_DELETED (replaced by tablet 2b45f60882664099b090170903fe74b2) from {username='slave'} at 127.0.0.1:56452
I20260620 14:47:53.615583 9342 tablet_bootstrap.cc:492] T 7a78d61e26c645b6bd82b6070c677b98 P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:53.615731 9342 ts_tablet_manager.cc:1397] T 7a78d61e26c645b6bd82b6070c677b98 P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.044s user 0.008s sys 0.014s
I20260620 14:47:53.616792 9342 raft_consensus.cc:348] T 7a78d61e26c645b6bd82b6070c677b98 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.617029 9342 raft_consensus.cc:374] T 7a78d61e26c645b6bd82b6070c677b98 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:53.617141 9342 raft_consensus.cc:729] T 7a78d61e26c645b6bd82b6070c677b98 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:53.617354 9342 consensus_queue.cc:260] T 7a78d61e26c645b6bd82b6070c677b98 P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.617973 9342 ts_tablet_manager.cc:1428] T 7a78d61e26c645b6bd82b6070c677b98 P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 14:47:53.618604 8637 tablet_service.cc:1467] Processing CreateTablet for tablet 2b45f60882664099b090170903fe74b2 (DEFAULT_TABLE table=default.table_0eb776233cee4294b6c96ec556447663 [id=3420fc1c9c8b45f49aeaa7b4c97da51e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:53.619848 8914 tablet_service.cc:1467] Processing CreateTablet for tablet 2b45f60882664099b090170903fe74b2 (DEFAULT_TABLE table=default.table_0eb776233cee4294b6c96ec556447663 [id=3420fc1c9c8b45f49aeaa7b4c97da51e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:53.620239 8914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b45f60882664099b090170903fe74b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:53.621040 9342 tablet_bootstrap.cc:492] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:53.622884 9342 tablet_bootstrap.cc:654] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:53.624802 9169 catalog_manager.cc:6565] ReplaceTablet: tablet c33a5b17df824c0ab066dee1fa610906 deleted and replaced by tablet 2b45f60882664099b090170903fe74b2
I20260620 14:47:53.625559 9169 master_service.cc:946] ReplaceTablet: received request to replace tablet 5f5a2717f7b243dea7faea56d5688ade from {username='slave'} at 127.0.0.1:38546
I20260620 14:47:53.627910 9333 tablet_bootstrap.cc:492] T 309a0915648643ada08981a11e7a1e59 P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:53.628070 9333 ts_tablet_manager.cc:1397] T 309a0915648643ada08981a11e7a1e59 P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.081s user 0.001s sys 0.010s
I20260620 14:47:53.628948 9333 raft_consensus.cc:348] T 309a0915648643ada08981a11e7a1e59 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.629220 9333 raft_consensus.cc:374] T 309a0915648643ada08981a11e7a1e59 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:53.629319 9333 raft_consensus.cc:729] T 309a0915648643ada08981a11e7a1e59 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:53.629571 9333 consensus_queue.cc:260] T 309a0915648643ada08981a11e7a1e59 P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.629658 8776 tablet_service.cc:1467] Processing CreateTablet for tablet 7a78d61e26c645b6bd82b6070c677b98 (DEFAULT_TABLE table=default.table_d2959bb621be429eb5af827263887798 [id=ddb41391569b4a11b4ad85335ca24ddb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:53.630024 8776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a78d61e26c645b6bd82b6070c677b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:53.631860 8777 tablet_service.cc:1467] Processing CreateTablet for tablet 73a17f00358f415d8b72a53859963eac (DEFAULT_TABLE table=default.table_7911231c2bcb420ebe8f3e12604c29e4 [id=76fec3007aa94f71867761f887e9b73e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:53.632202 8777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73a17f00358f415d8b72a53859963eac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:53.638618 9333 ts_tablet_manager.cc:1428] T 309a0915648643ada08981a11e7a1e59 P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260620 14:47:53.639991 8637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b45f60882664099b090170903fe74b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:53.640395 8777 tablet_service.cc:1514] Processing DeleteTablet for tablet c33a5b17df824c0ab066dee1fa610906 with delete_type TABLET_DATA_DELETED (replaced by tablet 2b45f60882664099b090170903fe74b2) from {username='slave'} at 127.0.0.1:49712
@ 0x7f438a8eeba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260620 14:47:53.642910 9326 tablet_replica.cc:330] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c: stopping tablet replica
I20260620 14:47:53.643198 9326 raft_consensus.cc:2229] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:47:53.644074 9326 raft_consensus.cc:2258] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:53.644443 9167 catalog_manager.cc:2148] created HMS catalog entry for table [id=7d2156b55c1349b2841c1d2676f74993]
I20260620 14:47:53.644789 9326 ts_tablet_manager.cc:1905] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:53.652153 9333 tablet_bootstrap.cc:492] T 73a17f00358f415d8b72a53859963eac P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:53.652186 9167 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:38546 (request call id 6) took 1193 ms. Trace:
I20260620 14:47:53.652277 9342 tablet_bootstrap.cc:492] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:53.652524 9342 ts_tablet_manager.cc:1397] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.032s user 0.005s sys 0.002s
I20260620 14:47:53.652734 9167 rpcz_store.cc:276] 0620 14:47:52.458539 (+ 0us) service_pool.cc:170] Inserting onto call queue
0620 14:47:52.458587 (+ 48us) service_pool.cc:227] Handling call
0620 14:47:52.668415 (+209828us) catalog_manager.cc:2075] Acquired catalog manager lock
0620 14:47:52.668920 (+ 505us) catalog_manager.cc:2121] Created new table and tablet info
0620 14:47:53.644383 (+975463us) catalog_manager.cc:2147] Created new table in HMS catalog
0620 14:47:53.651932 (+ 7549us) catalog_manager.cc:2181] Wrote table and tablets to system table
0620 14:47:53.652053 (+ 121us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0620 14:47:53.652147 (+ 94us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0620 14:47:53.645178 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0620 14:47:53.645301 (+ 123us) write_op.cc:432] Acquiring schema lock in shared mode
0620 14:47:53.645308 (+ 7us) write_op.cc:435] Acquired schema lock
0620 14:47:53.645311 (+ 3us) tablet.cc:660] Decoding operations
0620 14:47:53.645411 (+ 100us) write_op.cc:620] Acquiring the partition lock for write op
0620 14:47:53.645427 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0620 14:47:53.645432 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
0620 14:47:53.645523 (+ 91us) tablet.cc:699] Row locks acquired
0620 14:47:53.645526 (+ 3us) write_op.cc:260] PREPARE: finished
0620 14:47:53.645568 (+ 42us) write_op.cc:270] Start()
0620 14:47:53.645603 (+ 35us) write_op.cc:276] Timestamp: P: 1781966873645512 usec, L: 0
0620 14:47:53.645607 (+ 4us) op_driver.cc:331] REPLICATION: starting
0620 14:47:53.645785 (+ 178us) log.cc:842] Serialized 432 byte log entry
0620 14:47:53.650647 (+ 4862us) op_driver.cc:444] REPLICATION: finished
0620 14:47:53.651232 (+ 585us) write_op.cc:301] APPLY: starting
0620 14:47:53.651247 (+ 15us) tablet.cc:1365] starting BulkCheckPresence
0620 14:47:53.651295 (+ 48us) tablet.cc:1368] finished BulkCheckPresence
0620 14:47:53.651327 (+ 32us) tablet.cc:1370] starting ApplyRowOperation cycle
0620 14:47:53.651437 (+ 110us) tablet.cc:1381] finished ApplyRowOperation cycle
0620 14:47:53.651473 (+ 36us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0620 14:47:53.651480 (+ 7us) write_op.cc:312] APPLY: finished
0620 14:47:53.651563 (+ 83us) log.cc:842] Serialized 28 byte log entry
0620 14:47:53.651817 (+ 254us) write_op.cc:489] Releasing partition, row and schema locks
0620 14:47:53.651834 (+ 17us) write_op.cc:454] Released schema lock
0620 14:47:53.651841 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"Hive Metastore.queue_time_us":891702,"Hive Metastore.run_cpu_time_us":331,"Hive Metastore.run_wall_time_us":83610,"child_traces":[["op",{"apply.queue_time_us":519,"num_ops":2,"prepare.queue_time_us":60,"prepare.run_cpu_time_us":718,"prepare.run_wall_time_us":718,"raft.queue_time_us":637,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":303,"replication_time_us":5014}]]}
I20260620 14:47:53.653373 9342 raft_consensus.cc:348] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.653681 9342 raft_consensus.cc:374] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:53.653752 9342 raft_consensus.cc:729] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:53.653990 9342 consensus_queue.cc:260] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.654292 9333 tablet_bootstrap.cc:654] T 73a17f00358f415d8b72a53859963eac P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:53.658694 9342 ts_tablet_manager.cc:1428] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260620 14:47:53.661290 9342 tablet_bootstrap.cc:492] T 73a17f00358f415d8b72a53859963eac P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:53.662918 9342 tablet_bootstrap.cc:654] T 73a17f00358f415d8b72a53859963eac P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:53.663825 8777 tablet_service.cc:1467] Processing CreateTablet for tablet 2b45f60882664099b090170903fe74b2 (DEFAULT_TABLE table=default.table_0eb776233cee4294b6c96ec556447663 [id=3420fc1c9c8b45f49aeaa7b4c97da51e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:53.664314 8777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b45f60882664099b090170903fe74b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:53.665871 9326 ts_tablet_manager.cc:1918] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:53.669502 9326 log.cc:1196] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal/wals/c33a5b17df824c0ab066dee1fa610906
I20260620 14:47:53.669984 9326 ts_tablet_manager.cc:1939] T c33a5b17df824c0ab066dee1fa610906 P 36236dd5bd604ba2819038e525a3790c: Deleting consensus metadata
I20260620 14:47:53.671768 9337 ts_tablet_manager.cc:1918] T c33a5b17df824c0ab066dee1fa610906 P c0e6c57ab91e42bf9be3739c816916c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:53.671940 9337 log.cc:1196] T c33a5b17df824c0ab066dee1fa610906 P c0e6c57ab91e42bf9be3739c816916c0: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/wal/wals/c33a5b17df824c0ab066dee1fa610906
I20260620 14:47:53.672390 9337 ts_tablet_manager.cc:1939] T c33a5b17df824c0ab066dee1fa610906 P c0e6c57ab91e42bf9be3739c816916c0: Deleting consensus metadata
I20260620 14:47:53.673671 9138 catalog_manager.cc:4841] TS c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821): tablet c33a5b17df824c0ab066dee1fa610906 (table default.table_0eb776233cee4294b6c96ec556447663 [id=3420fc1c9c8b45f49aeaa7b4c97da51e]) successfully deleted
I20260620 14:47:53.677428 9333 tablet_bootstrap.cc:492] T 73a17f00358f415d8b72a53859963eac P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:53.677626 9333 ts_tablet_manager.cc:1397] T 73a17f00358f415d8b72a53859963eac P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.000s
I20260620 14:47:53.678630 9333 raft_consensus.cc:348] T 73a17f00358f415d8b72a53859963eac P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.678921 9333 raft_consensus.cc:374] T 73a17f00358f415d8b72a53859963eac P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:53.678998 9333 raft_consensus.cc:729] T 73a17f00358f415d8b72a53859963eac P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:53.679387 9140 catalog_manager.cc:4841] TS 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): tablet 3a85749745a7440fb637d4918de5f798 (table default.table_de1c78a84d1349dea4d9e9d032a258be [id=a78802b888ed44b5b439381a6890a67d]) successfully deleted
I20260620 14:47:53.679294 9333 consensus_queue.cc:260] T 73a17f00358f415d8b72a53859963eac P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.679781 9140 catalog_manager.cc:4841] TS 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): tablet c33a5b17df824c0ab066dee1fa610906 (table default.table_0eb776233cee4294b6c96ec556447663 [id=3420fc1c9c8b45f49aeaa7b4c97da51e]) successfully deleted
I20260620 14:47:53.683338 9333 ts_tablet_manager.cc:1428] T 73a17f00358f415d8b72a53859963eac P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260620 14:47:53.683625 9333 tablet_bootstrap.cc:492] T 7a78d61e26c645b6bd82b6070c677b98 P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:53.685910 9333 tablet_bootstrap.cc:654] T 7a78d61e26c645b6bd82b6070c677b98 P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:53.694483 9333 tablet_bootstrap.cc:492] T 7a78d61e26c645b6bd82b6070c677b98 P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:53.694778 9333 ts_tablet_manager.cc:1397] T 7a78d61e26c645b6bd82b6070c677b98 P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.003s
I20260620 14:47:53.695644 9169 catalog_manager.cc:5782] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Sending DeleteTablet for 3 replicas of tablet 5f5a2717f7b243dea7faea56d5688ade
I20260620 14:47:53.696019 9333 raft_consensus.cc:348] T 7a78d61e26c645b6bd82b6070c677b98 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.696215 9169 catalog_manager.cc:6565] ReplaceTablet: tablet 5f5a2717f7b243dea7faea56d5688ade deleted and replaced by tablet 1c65081e59334f90839952e5d1eda960
I20260620 14:47:53.696277 9333 raft_consensus.cc:374] T 7a78d61e26c645b6bd82b6070c677b98 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:53.696364 9333 raft_consensus.cc:729] T 7a78d61e26c645b6bd82b6070c677b98 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:53.696730 9333 consensus_queue.cc:260] T 7a78d61e26c645b6bd82b6070c677b98 P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.696900 8637 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f5a2717f7b243dea7faea56d5688ade with delete_type TABLET_DATA_DELETED (replaced by tablet 1c65081e59334f90839952e5d1eda960) from {username='slave'} at 127.0.0.1:52288
I20260620 14:47:53.697217 9337 tablet_replica.cc:330] T 5f5a2717f7b243dea7faea56d5688ade P c0e6c57ab91e42bf9be3739c816916c0: stopping tablet replica
I20260620 14:47:53.697173 8913 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f5a2717f7b243dea7faea56d5688ade with delete_type TABLET_DATA_DELETED (replaced by tablet 1c65081e59334f90839952e5d1eda960) from {username='slave'} at 127.0.0.1:56452
I20260620 14:47:53.697433 9337 raft_consensus.cc:2229] T 5f5a2717f7b243dea7faea56d5688ade P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:53.697615 9337 raft_consensus.cc:2258] T 5f5a2717f7b243dea7faea56d5688ade P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:53.697595 9333 ts_tablet_manager.cc:1428] T 7a78d61e26c645b6bd82b6070c677b98 P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260620 14:47:53.698495 9337 ts_tablet_manager.cc:1905] T 5f5a2717f7b243dea7faea56d5688ade P c0e6c57ab91e42bf9be3739c816916c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:53.702782 9324 tablet_replica.cc:330] T c33a5b17df824c0ab066dee1fa610906 P 6c99207e35f8463292d71c371c9546b4: stopping tablet replica
I20260620 14:47:53.703081 9138 catalog_manager.cc:4841] TS 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): tablet 3a85749745a7440fb637d4918de5f798 (table default.table_de1c78a84d1349dea4d9e9d032a258be [id=a78802b888ed44b5b439381a6890a67d]) successfully deleted
I20260620 14:47:53.703112 9324 raft_consensus.cc:2229] T c33a5b17df824c0ab066dee1fa610906 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:53.703367 9324 raft_consensus.cc:2258] T c33a5b17df824c0ab066dee1fa610906 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:53.704288 9324 ts_tablet_manager.cc:1905] T c33a5b17df824c0ab066dee1fa610906 P 6c99207e35f8463292d71c371c9546b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:53.706082 9337 ts_tablet_manager.cc:1918] T 5f5a2717f7b243dea7faea56d5688ade P c0e6c57ab91e42bf9be3739c816916c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:53.706218 9337 log.cc:1196] T 5f5a2717f7b243dea7faea56d5688ade P c0e6c57ab91e42bf9be3739c816916c0: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/wal/wals/5f5a2717f7b243dea7faea56d5688ade
I20260620 14:47:53.706624 9337 ts_tablet_manager.cc:1939] T 5f5a2717f7b243dea7faea56d5688ade P c0e6c57ab91e42bf9be3739c816916c0: Deleting consensus metadata
I20260620 14:47:53.707628 9138 catalog_manager.cc:4841] TS c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821): tablet 5f5a2717f7b243dea7faea56d5688ade (table default.table_1ea7c21a49a443c29bd5578c5950c27f [id=bfa17da52a874fa1b587ad18d04cd740]) successfully deleted
I20260620 14:47:53.708927 9328 tablet_bootstrap.cc:492] T 309a0915648643ada08981a11e7a1e59 P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:53.709043 9328 ts_tablet_manager.cc:1397] T 309a0915648643ada08981a11e7a1e59 P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.130s user 0.003s sys 0.008s
I20260620 14:47:53.709434 9199 generic_service.cc:196] Checking for leaks (request via RPC)
I20260620 14:47:53.709779 8776 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f5a2717f7b243dea7faea56d5688ade with delete_type TABLET_DATA_DELETED (replaced by tablet 1c65081e59334f90839952e5d1eda960) from {username='slave'} at 127.0.0.1:49712
I20260620 14:47:53.710669 9326 tablet_replica.cc:330] T 5f5a2717f7b243dea7faea56d5688ade P 36236dd5bd604ba2819038e525a3790c: stopping tablet replica
I20260620 14:47:53.710876 9326 raft_consensus.cc:2229] T 5f5a2717f7b243dea7faea56d5688ade P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:53.711102 9326 raft_consensus.cc:2258] T 5f5a2717f7b243dea7faea56d5688ade P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:53.712034 9326 ts_tablet_manager.cc:1905] T 5f5a2717f7b243dea7faea56d5688ade P 36236dd5bd604ba2819038e525a3790c: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7f438a8ed901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260620 14:47:53.719904 9342 tablet_bootstrap.cc:492] T 73a17f00358f415d8b72a53859963eac P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:53.720072 9342 ts_tablet_manager.cc:1397] T 73a17f00358f415d8b72a53859963eac P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.059s user 0.018s sys 0.029s
I20260620 14:47:53.720952 9342 raft_consensus.cc:348] T 73a17f00358f415d8b72a53859963eac P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.721220 9342 raft_consensus.cc:374] T 73a17f00358f415d8b72a53859963eac P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:53.721313 9342 raft_consensus.cc:729] T 73a17f00358f415d8b72a53859963eac P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:53.721638 9342 consensus_queue.cc:260] T 73a17f00358f415d8b72a53859963eac P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.723290 9328 raft_consensus.cc:348] T 309a0915648643ada08981a11e7a1e59 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.723543 9328 raft_consensus.cc:374] T 309a0915648643ada08981a11e7a1e59 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:53.723647 9328 raft_consensus.cc:729] T 309a0915648643ada08981a11e7a1e59 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:53.724964 9324 ts_tablet_manager.cc:1918] T c33a5b17df824c0ab066dee1fa610906 P 6c99207e35f8463292d71c371c9546b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:53.725109 9324 log.cc:1196] T c33a5b17df824c0ab066dee1fa610906 P 6c99207e35f8463292d71c371c9546b4: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal/wals/c33a5b17df824c0ab066dee1fa610906
I20260620 14:47:53.725561 9324 ts_tablet_manager.cc:1939] T c33a5b17df824c0ab066dee1fa610906 P 6c99207e35f8463292d71c371c9546b4: Deleting consensus metadata
I20260620 14:47:53.725879 9342 ts_tablet_manager.cc:1428] T 73a17f00358f415d8b72a53859963eac P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260620 14:47:53.726543 9324 tablet_replica.cc:330] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4: stopping tablet replica
I20260620 14:47:53.726749 9324 raft_consensus.cc:2229] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:47:53.726796 9328 consensus_queue.cc:260] T 309a0915648643ada08981a11e7a1e59 P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.726984 9326 ts_tablet_manager.cc:1918] T 5f5a2717f7b243dea7faea56d5688ade P 36236dd5bd604ba2819038e525a3790c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:53.727108 9326 log.cc:1196] T 5f5a2717f7b243dea7faea56d5688ade P 36236dd5bd604ba2819038e525a3790c: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal/wals/5f5a2717f7b243dea7faea56d5688ade
I20260620 14:47:53.727097 9324 raft_consensus.cc:2258] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:53.727502 9326 ts_tablet_manager.cc:1939] T 5f5a2717f7b243dea7faea56d5688ade P 36236dd5bd604ba2819038e525a3790c: Deleting consensus metadata
@ 0x7f438a8f466c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260620 14:47:53.728823 9342 tablet_bootstrap.cc:492] T 2b45f60882664099b090170903fe74b2 P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:53.729416 9333 tablet_bootstrap.cc:492] T 2b45f60882664099b090170903fe74b2 P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:53.730679 9328 ts_tablet_manager.cc:1428] T 309a0915648643ada08981a11e7a1e59 P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20260620 14:47:53.731155 9328 tablet_bootstrap.cc:492] T 7a78d61e26c645b6bd82b6070c677b98 P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
@ 0x7f438a8f44e9 std::_Function_handler<>::_M_invoke() at ??:0
I20260620 14:47:53.733026 9328 tablet_bootstrap.cc:654] T 7a78d61e26c645b6bd82b6070c677b98 P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
@ 0x9edb7d std::function<>::operator()() at ??:?
I20260620 14:47:53.735879 9102 raft_consensus.cc:482] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:53.736068 9102 raft_consensus.cc:504] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.736912 9102 leader_election.cc:288] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:47:53.737998 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "309a0915648643ada08981a11e7a1e59" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4" is_pre_election: true
I20260620 14:47:53.738345 8935 raft_consensus.cc:2454] T 309a0915648643ada08981a11e7a1e59 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 0.
@ 0x7f437797aeaf kudu::Thread::SuperviseThread() at ??:0
I20260620 14:47:53.738833 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "309a0915648643ada08981a11e7a1e59" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:47:53.738920 8596 leader_election.cc:302] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:53.739091 8799 raft_consensus.cc:2454] T 309a0915648643ada08981a11e7a1e59 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 0.
I20260620 14:47:53.740890 9102 raft_consensus.cc:2781] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:53.741024 9102 raft_consensus.cc:482] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:53.741117 9102 raft_consensus.cc:3037] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
@ 0x7f437ac546db start_thread at ??:0
I20260620 14:47:53.741367 9333 tablet_bootstrap.cc:654] T 2b45f60882664099b090170903fe74b2 P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
@ 0x7f4373bea61f clone at ??:0
I20260620 14:47:53.744252 9328 tablet_bootstrap.cc:492] T 7a78d61e26c645b6bd82b6070c677b98 P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:53.744468 9328 ts_tablet_manager.cc:1397] T 7a78d61e26c645b6bd82b6070c677b98 P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.004s
I20260620 14:47:53.744516 9102 raft_consensus.cc:504] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.745334 9324 ts_tablet_manager.cc:1905] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:53.745579 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "309a0915648643ada08981a11e7a1e59" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:47:53.745497 9328 raft_consensus.cc:348] T 7a78d61e26c645b6bd82b6070c677b98 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.745805 8799 raft_consensus.cc:3037] T 309a0915648643ada08981a11e7a1e59 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:53.745801 9328 raft_consensus.cc:374] T 7a78d61e26c645b6bd82b6070c677b98 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:53.745898 9328 raft_consensus.cc:729] T 7a78d61e26c645b6bd82b6070c677b98 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:53.746214 9328 consensus_queue.cc:260] T 7a78d61e26c645b6bd82b6070c677b98 P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.747303 9328 ts_tablet_manager.cc:1428] T 7a78d61e26c645b6bd82b6070c677b98 P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 14:47:53.748122 9328 tablet_bootstrap.cc:492] T 73a17f00358f415d8b72a53859963eac P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:53.748477 8799 raft_consensus.cc:2454] T 309a0915648643ada08981a11e7a1e59 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 1.
I20260620 14:47:53.748910 8598 leader_election.cc:302] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:53.749894 9328 tablet_bootstrap.cc:654] T 73a17f00358f415d8b72a53859963eac P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:53.751924 9333 tablet_bootstrap.cc:492] T 2b45f60882664099b090170903fe74b2 P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:53.752538 9324 ts_tablet_manager.cc:1918] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:53.752676 9324 log.cc:1196] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal/wals/5f5a2717f7b243dea7faea56d5688ade
I20260620 14:47:53.752861 9333 ts_tablet_manager.cc:1397] T 2b45f60882664099b090170903fe74b2 P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.003s
I20260620 14:47:53.754766 9333 raft_consensus.cc:348] T 2b45f60882664099b090170903fe74b2 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.755007 9342 tablet_bootstrap.cc:654] T 2b45f60882664099b090170903fe74b2 P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:53.755016 9333 raft_consensus.cc:374] T 2b45f60882664099b090170903fe74b2 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:53.755095 9333 raft_consensus.cc:729] T 2b45f60882664099b090170903fe74b2 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:53.755374 9333 consensus_queue.cc:260] T 2b45f60882664099b090170903fe74b2 P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.756835 9102 leader_election.cc:288] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 election: Requested vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:47:53.757081 9102 raft_consensus.cc:2781] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:53.757225 9102 raft_consensus.cc:686] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 LEADER]: Becoming Leader. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Running, Role: LEADER
I20260620 14:47:53.757560 9102 consensus_queue.cc:237] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.757921 9324 ts_tablet_manager.cc:1939] T 5f5a2717f7b243dea7faea56d5688ade P 6c99207e35f8463292d71c371c9546b4: Deleting consensus metadata
I20260620 14:47:53.761361 9333 ts_tablet_manager.cc:1428] T 2b45f60882664099b090170903fe74b2 P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260620 14:47:53.765440 9328 tablet_bootstrap.cc:492] T 73a17f00358f415d8b72a53859963eac P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:53.765621 9328 ts_tablet_manager.cc:1397] T 73a17f00358f415d8b72a53859963eac P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.003s
I20260620 14:47:53.766376 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "309a0915648643ada08981a11e7a1e59" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4"
I20260620 14:47:53.766736 8935 raft_consensus.cc:3037] T 309a0915648643ada08981a11e7a1e59 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:53.766631 9328 raft_consensus.cc:348] T 73a17f00358f415d8b72a53859963eac P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.766904 9328 raft_consensus.cc:374] T 73a17f00358f415d8b72a53859963eac P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:53.767518 9328 raft_consensus.cc:729] T 73a17f00358f415d8b72a53859963eac P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:53.767835 9328 consensus_queue.cc:260] T 73a17f00358f415d8b72a53859963eac P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.773023 9328 ts_tablet_manager.cc:1428] T 73a17f00358f415d8b72a53859963eac P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.007s user 0.002s sys 0.002s
I20260620 14:47:53.774374 8935 raft_consensus.cc:2454] T 309a0915648643ada08981a11e7a1e59 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 1.
I20260620 14:47:53.775688 9328 tablet_bootstrap.cc:492] T 2b45f60882664099b090170903fe74b2 P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:53.777911 9328 tablet_bootstrap.cc:654] T 2b45f60882664099b090170903fe74b2 P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:53.779735 9342 tablet_bootstrap.cc:492] T 2b45f60882664099b090170903fe74b2 P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:53.780114 9342 ts_tablet_manager.cc:1397] T 2b45f60882664099b090170903fe74b2 P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.051s user 0.006s sys 0.018s
I20260620 14:47:53.781127 9342 raft_consensus.cc:348] T 2b45f60882664099b090170903fe74b2 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.781368 9342 raft_consensus.cc:374] T 2b45f60882664099b090170903fe74b2 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:53.781438 9342 raft_consensus.cc:729] T 2b45f60882664099b090170903fe74b2 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:53.781708 9342 consensus_queue.cc:260] T 2b45f60882664099b090170903fe74b2 P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.788498 9102 raft_consensus.cc:482] T 7a78d61e26c645b6bd82b6070c677b98 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:53.788735 9102 raft_consensus.cc:504] T 7a78d61e26c645b6bd82b6070c677b98 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.790153 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a78d61e26c645b6bd82b6070c677b98" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4" is_pre_election: true
I20260620 14:47:53.790467 8935 raft_consensus.cc:2454] T 7a78d61e26c645b6bd82b6070c677b98 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 0.
I20260620 14:47:53.791014 8596 leader_election.cc:302] T 7a78d61e26c645b6bd82b6070c677b98 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:53.795527 9102 leader_election.cc:288] T 7a78d61e26c645b6bd82b6070c677b98 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:47:53.799816 9102 raft_consensus.cc:2781] T 7a78d61e26c645b6bd82b6070c677b98 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:53.799948 9102 raft_consensus.cc:482] T 7a78d61e26c645b6bd82b6070c677b98 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:53.800086 9102 raft_consensus.cc:3037] T 7a78d61e26c645b6bd82b6070c677b98 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:53.808228 9102 raft_consensus.cc:504] T 7a78d61e26c645b6bd82b6070c677b98 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.812402 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a78d61e26c645b6bd82b6070c677b98" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4"
I20260620 14:47:53.812704 8935 raft_consensus.cc:3037] T 7a78d61e26c645b6bd82b6070c677b98 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:53.824570 8935 raft_consensus.cc:2454] T 7a78d61e26c645b6bd82b6070c677b98 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 1.
I20260620 14:47:53.830626 9054 raft_consensus.cc:482] T 2b45f60882664099b090170903fe74b2 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:53.830823 9054 raft_consensus.cc:504] T 2b45f60882664099b090170903fe74b2 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.831696 9054 leader_election.cc:288] T 2b45f60882664099b090170903fe74b2 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:47:53.832567 8934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b45f60882664099b090170903fe74b2" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4" is_pre_election: true
W20260620 14:47:53.833273 8733 leader_election.cc:341] T 2b45f60882664099b090170903fe74b2 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260620 14:47:53.833897 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b45f60882664099b090170903fe74b2" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:47:53.834182 8659 raft_consensus.cc:2454] T 2b45f60882664099b090170903fe74b2 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 0.
I20260620 14:47:53.834630 8733 leader_election.cc:302] T 2b45f60882664099b090170903fe74b2 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, c0e6c57ab91e42bf9be3739c816916c0; no voters: 6c99207e35f8463292d71c371c9546b4
I20260620 14:47:53.835103 9054 raft_consensus.cc:2781] T 2b45f60882664099b090170903fe74b2 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:53.835229 9054 raft_consensus.cc:482] T 2b45f60882664099b090170903fe74b2 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:53.835332 9054 raft_consensus.cc:3037] T 2b45f60882664099b090170903fe74b2 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:53.839077 9054 raft_consensus.cc:504] T 2b45f60882664099b090170903fe74b2 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.840400 8934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b45f60882664099b090170903fe74b2" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4"
W20260620 14:47:53.841478 8733 leader_election.cc:341] T 2b45f60882664099b090170903fe74b2 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260620 14:47:53.841936 9054 leader_election.cc:288] T 2b45f60882664099b090170903fe74b2 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 election: Requested vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:47:53.842583 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b45f60882664099b090170903fe74b2" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:47:53.842841 8659 raft_consensus.cc:3037] T 2b45f60882664099b090170903fe74b2 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:53.846881 8659 raft_consensus.cc:2454] T 2b45f60882664099b090170903fe74b2 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 1.
I20260620 14:47:53.847365 8733 leader_election.cc:302] T 2b45f60882664099b090170903fe74b2 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, c0e6c57ab91e42bf9be3739c816916c0; no voters: 6c99207e35f8463292d71c371c9546b4
I20260620 14:47:53.848001 9054 raft_consensus.cc:2781] T 2b45f60882664099b090170903fe74b2 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:53.848766 8596 leader_election.cc:302] T 7a78d61e26c645b6bd82b6070c677b98 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0; no voters:
W20260620 14:47:53.849289 8598 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.222.194:39159, user_credentials={real_user=slave}} blocked reactor thread for 100369us
I20260620 14:47:53.850901 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a78d61e26c645b6bd82b6070c677b98" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:47:53.851217 8799 raft_consensus.cc:2454] T 7a78d61e26c645b6bd82b6070c677b98 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 0.
I20260620 14:47:53.852293 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a78d61e26c645b6bd82b6070c677b98" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:47:53.852545 8799 raft_consensus.cc:3037] T 7a78d61e26c645b6bd82b6070c677b98 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:53.856427 8799 raft_consensus.cc:2454] T 7a78d61e26c645b6bd82b6070c677b98 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 1.
I20260620 14:47:53.858351 9400 raft_consensus.cc:2781] T 7a78d61e26c645b6bd82b6070c677b98 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:53.858578 9400 raft_consensus.cc:686] T 7a78d61e26c645b6bd82b6070c677b98 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 LEADER]: Becoming Leader. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Running, Role: LEADER
I20260620 14:47:53.858942 9400 consensus_queue.cc:237] T 7a78d61e26c645b6bd82b6070c677b98 P c0e6c57ab91e42bf9be3739c816916c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.861941 9054 raft_consensus.cc:686] T 2b45f60882664099b090170903fe74b2 P 36236dd5bd604ba2819038e525a3790c [term 1 LEADER]: Becoming Leader. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Running, Role: LEADER
I20260620 14:47:53.862447 9054 consensus_queue.cc:237] T 2b45f60882664099b090170903fe74b2 P 36236dd5bd604ba2819038e525a3790c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.867074 9102 leader_election.cc:288] T 7a78d61e26c645b6bd82b6070c677b98 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 election: Requested vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:47:53.880595 9062 raft_consensus.cc:482] T 73a17f00358f415d8b72a53859963eac P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:53.880782 9062 raft_consensus.cc:504] T 73a17f00358f415d8b72a53859963eac P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.881385 9062 leader_election.cc:288] T 73a17f00358f415d8b72a53859963eac P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:47:53.882395 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73a17f00358f415d8b72a53859963eac" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:47:53.882659 8659 raft_consensus.cc:2454] T 73a17f00358f415d8b72a53859963eac P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:53.883107 8869 leader_election.cc:302] T 73a17f00358f415d8b72a53859963eac P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:53.883361 9062 raft_consensus.cc:2781] T 73a17f00358f415d8b72a53859963eac P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:53.883481 9062 raft_consensus.cc:482] T 73a17f00358f415d8b72a53859963eac P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:53.883560 9062 raft_consensus.cc:3037] T 73a17f00358f415d8b72a53859963eac P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:53.886548 9062 raft_consensus.cc:504] T 73a17f00358f415d8b72a53859963eac P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.888713 8798 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73a17f00358f415d8b72a53859963eac" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:47:53.889031 8798 raft_consensus.cc:3037] T 73a17f00358f415d8b72a53859963eac P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:53.893764 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73a17f00358f415d8b72a53859963eac" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:47:53.894338 9342 ts_tablet_manager.cc:1428] T 2b45f60882664099b090170903fe74b2 P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.114s user 0.038s sys 0.059s
I20260620 14:47:53.894522 8659 raft_consensus.cc:3037] T 73a17f00358f415d8b72a53859963eac P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:53.898512 8659 raft_consensus.cc:2454] T 73a17f00358f415d8b72a53859963eac P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:53.899004 8869 leader_election.cc:302] T 73a17f00358f415d8b72a53859963eac P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:53.899379 9228 raft_consensus.cc:2781] T 73a17f00358f415d8b72a53859963eac P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:53.899539 9228 raft_consensus.cc:686] T 73a17f00358f415d8b72a53859963eac P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Becoming Leader. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Running, Role: LEADER
I20260620 14:47:53.899791 9228 consensus_queue.cc:237] T 73a17f00358f415d8b72a53859963eac P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.902709 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73a17f00358f415d8b72a53859963eac" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:47:53.903628 9062 leader_election.cc:288] T 73a17f00358f415d8b72a53859963eac P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Requested vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:47:53.903815 8798 raft_consensus.cc:2454] T 73a17f00358f415d8b72a53859963eac P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:53.914361 9328 tablet_bootstrap.cc:492] T 2b45f60882664099b090170903fe74b2 P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:53.914556 9328 ts_tablet_manager.cc:1397] T 2b45f60882664099b090170903fe74b2 P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.139s user 0.031s sys 0.064s
I20260620 14:47:53.915395 9328 raft_consensus.cc:348] T 2b45f60882664099b090170903fe74b2 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.915652 9328 raft_consensus.cc:374] T 2b45f60882664099b090170903fe74b2 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:53.915711 9328 raft_consensus.cc:729] T 2b45f60882664099b090170903fe74b2 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:53.915972 9328 consensus_queue.cc:260] T 2b45f60882664099b090170903fe74b2 P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:53.916491 9328 ts_tablet_manager.cc:1428] T 2b45f60882664099b090170903fe74b2 P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 14:47:53.931841 9228 consensus_queue.cc:1035] T c4e5daabb2954a6f955fd4857b362884 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:53.939944 9228 consensus_queue.cc:1035] T c4e5daabb2954a6f955fd4857b362884 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 14:47:54.086498 8989 connection.cc:535] client connection to 127.7.222.253:34209 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 14:47:54.086568 8059 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task9VKlbC/build/asan/bin/kudu pid 9083: Network error: recv got EOF from 127.7.222.253:34209 (error 108)
I20260620 14:47:54.086824 8059 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9VKlbC/build/asan/bin/kudu with pid 9083
W20260620 14:47:54.086763 8869 connection.cc:535] server connection from 127.0.0.1:56452 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 14:47:54.087056 8989 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.7.222.253:34209)
W20260620 14:47:54.087378 8989 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.7.222.253:34209)
W20260620 14:47:54.088059 8989 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.7.222.253:34209)
W20260620 14:47:54.089231 8989 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.7.222.253:34209)
W20260620 14:47:54.091316 9424 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:47:54.089200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.222.253:34209 (local address 127.7.222.193:33785)
0620 14:47:54.089958 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0620 14:47:54.089982 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0620 14:47:54.090119 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:47:54.090310 (+ 191us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: BlockingWrite error: write error: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":454,"threads_started":1}
W20260620 14:47:54.091791 9425 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:47:54.089199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.222.253:34209 (local address 127.7.222.194:56695)
0620 14:47:54.090792 (+ 1593us) negotiation.cc:107] Waiting for socket to connect
0620 14:47:54.090914 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":1485,"thread_start_us":1354,"threads_started":1}
I20260620 14:47:54.184028 9428 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader caa9dcf251944f7d97f4ed7f3d83af44)
I20260620 14:47:54.184271 9428 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:54.185112 9428 leader_election.cc:288] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209)
I20260620 14:47:54.185719 8340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "61512e6d316d4d3a998e52511a0bba7a" candidate_term: 3 candidate_status { last_received { term: 2 index: 91 } } ignore_live_leader: false dest_uuid: "dd308569015348a7a19ba4a560de6d52" is_pre_election: true
W20260620 14:47:54.187446 8457 leader_election.cc:334] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209): Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
I20260620 14:47:54.187626 8457 leader_election.cc:302] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61512e6d316d4d3a998e52511a0bba7a; no voters: caa9dcf251944f7d97f4ed7f3d83af44, dd308569015348a7a19ba4a560de6d52
I20260620 14:47:54.187978 9428 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 14:47:54.218196 9431 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader caa9dcf251944f7d97f4ed7f3d83af44)
I20260620 14:47:54.218464 9431 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:54.219211 9431 leader_election.cc:288] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
I20260620 14:47:54.219818 8480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dd308569015348a7a19ba4a560de6d52" candidate_term: 3 candidate_status { last_received { term: 2 index: 91 } } ignore_live_leader: false dest_uuid: "61512e6d316d4d3a998e52511a0bba7a" is_pre_election: true
I20260620 14:47:54.220129 8480 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd308569015348a7a19ba4a560de6d52 in term 2.
W20260620 14:47:54.220326 8317 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111) [suppressed 11 similar messages]
I20260620 14:47:54.221468 8318 leader_election.cc:302] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52; no voters:
I20260620 14:47:54.221804 9431 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260620 14:47:54.222100 8317 leader_election.cc:334] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209): Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
I20260620 14:47:54.222167 9431 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 2 FOLLOWER]: Starting leader election (detected failure of leader caa9dcf251944f7d97f4ed7f3d83af44)
I20260620 14:47:54.222328 9431 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 2 FOLLOWER]: Advancing to term 3
I20260620 14:47:54.279292 9431 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:54.280227 9431 leader_election.cc:288] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 3 election: Requested vote from peers caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
I20260620 14:47:54.281585 8480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dd308569015348a7a19ba4a560de6d52" candidate_term: 3 candidate_status { last_received { term: 2 index: 91 } } ignore_live_leader: false dest_uuid: "61512e6d316d4d3a998e52511a0bba7a"
I20260620 14:47:54.281806 8480 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 2 FOLLOWER]: Advancing to term 3
W20260620 14:47:54.282141 8317 leader_election.cc:334] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209): Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
I20260620 14:47:54.282251 9228 consensus_queue.cc:1035] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:54.284735 8480 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd308569015348a7a19ba4a560de6d52 in term 3.
I20260620 14:47:54.285277 8318 leader_election.cc:302] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52; no voters: caa9dcf251944f7d97f4ed7f3d83af44
I20260620 14:47:54.285584 9431 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 14:47:54.287345 9431 raft_consensus.cc:686] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 3 LEADER]: Becoming Leader. State: Replica: dd308569015348a7a19ba4a560de6d52, State: Running, Role: LEADER
I20260620 14:47:54.287660 9431 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 91, Committed index: 91, Last appended: 2.91, Last appended by leader: 91, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:54.289299 9435 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd308569015348a7a19ba4a560de6d52. Latest consensus state: current_term: 3 leader_uuid: "dd308569015348a7a19ba4a560de6d52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:54.289688 9435 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: This master's current role is: LEADER
I20260620 14:47:54.290906 9436 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:47:54.291745 9234 consensus_queue.cc:1035] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:54.294538 9436 catalog_manager.cc:669] Loaded metadata for table default.table_4ab72ecdb6d540508f6f4b250020b540 [id=0c4867ea1c1e45f388ccd4e2c9de093e]
I20260620 14:47:54.295431 9436 catalog_manager.cc:669] Loaded metadata for table default.table_8cc72697ee4f4200a5f57a19280315ee [id=1db81c7e90894c5fac0e8fe34d1d4441]
I20260620 14:47:54.297415 9436 catalog_manager.cc:669] Loaded metadata for table default.table_105950e097bf4cbda12e7532557966b2 [id=34076de884f942fcb696a9c9524941e7]
I20260620 14:47:54.297835 9436 catalog_manager.cc:669] Loaded metadata for table default.table_0eb776233cee4294b6c96ec556447663 [id=3420fc1c9c8b45f49aeaa7b4c97da51e]
I20260620 14:47:54.298244 9436 catalog_manager.cc:669] Loaded metadata for table default.table_154fc524efb24453bdb6d735e4c741e9 [id=3b08ae3b47fd46cab8ef5a41bb0bc5d7]
I20260620 14:47:54.298646 9436 catalog_manager.cc:669] Loaded metadata for table default.table_bb493f9370e74bafae7b1e42f5c5f770 [id=6a722b39b30e45649b7b70c32c9e2260]
I20260620 14:47:54.299088 9436 catalog_manager.cc:669] Loaded metadata for table default.table_7911231c2bcb420ebe8f3e12604c29e4 [id=76fec3007aa94f71867761f887e9b73e]
I20260620 14:47:54.299515 9436 catalog_manager.cc:669] Loaded metadata for table default.table_16339630485f49f6a8bb2b71981cdeb1 [id=7d2156b55c1349b2841c1d2676f74993]
I20260620 14:47:54.299932 9436 catalog_manager.cc:669] Loaded metadata for table default.table_563392802bec4e688c0eabd46ab1fd5c [id=7e71694fb4a948f09c01863575227fda]
I20260620 14:47:54.300534 9436 catalog_manager.cc:669] Loaded metadata for table default.table_fdbead99862d49af98df44683e830bf5 [id=85b633c4801d49bd9ad9b944b178e683]
I20260620 14:47:54.300905 9436 catalog_manager.cc:669] Loaded metadata for table default.table_98318448fcf3484cb76812dad2975098 [id=862dd3cee25c40eead9feb394a8b58b1]
I20260620 14:47:54.301254 9436 catalog_manager.cc:669] Loaded metadata for table default.table_19c624001d444b7b9939e22128c594aa [id=98d2e7b647544a97b50827a0cb2799a0]
I20260620 14:47:54.301633 9436 catalog_manager.cc:669] Loaded metadata for table default.table_e8372b71bacb4865b4360a50af59d323 [id=9c1e21a6c9244efba2e86bfa28264a0d]
I20260620 14:47:54.302106 9436 catalog_manager.cc:669] Loaded metadata for table default.table_1ea7c21a49a443c29bd5578c5950c27f [id=bfa17da52a874fa1b587ad18d04cd740]
I20260620 14:47:54.302414 9436 catalog_manager.cc:669] Loaded metadata for table default.table_fe5ad6a8d59b4751bcbb6e1d0d4baedb [id=c514aca79062490a8b6a18021b07b2ff]
I20260620 14:47:54.302739 9436 catalog_manager.cc:669] Loaded metadata for table default.table_a901d915c377429a9e43cfcaf071e7d3 [id=c65e926af55d4fbba6c42f4d2ddbb397]
I20260620 14:47:54.303192 9436 catalog_manager.cc:669] Loaded metadata for table default.table_d2959bb621be429eb5af827263887798 [id=ddb41391569b4a11b4ad85335ca24ddb]
I20260620 14:47:54.306027 9436 tablet_loader.cc:96] loaded metadata for tablet 1ad679f398ab41a1bc207b016648cbe8 (table default.table_19c624001d444b7b9939e22128c594aa [id=98d2e7b647544a97b50827a0cb2799a0])
I20260620 14:47:54.306344 9436 tablet_loader.cc:96] loaded metadata for tablet 1c65081e59334f90839952e5d1eda960 (table default.table_1ea7c21a49a443c29bd5578c5950c27f [id=bfa17da52a874fa1b587ad18d04cd740])
I20260620 14:47:54.306921 9436 tablet_loader.cc:96] loaded metadata for tablet 26639d34678c4f77994cd44313b98898 (table default.table_16339630485f49f6a8bb2b71981cdeb1 [id=7d2156b55c1349b2841c1d2676f74993])
I20260620 14:47:54.307242 9436 tablet_loader.cc:96] loaded metadata for tablet 2b45f60882664099b090170903fe74b2 (table default.table_0eb776233cee4294b6c96ec556447663 [id=3420fc1c9c8b45f49aeaa7b4c97da51e])
I20260620 14:47:54.307758 9436 tablet_loader.cc:96] loaded metadata for tablet 309a0915648643ada08981a11e7a1e59 (table default.table_563392802bec4e688c0eabd46ab1fd5c [id=7e71694fb4a948f09c01863575227fda])
I20260620 14:47:54.308465 9436 tablet_loader.cc:96] loaded metadata for tablet 493a30104eab4762a3f4ffae3491765e (table default.table_fdbead99862d49af98df44683e830bf5 [id=85b633c4801d49bd9ad9b944b178e683])
I20260620 14:47:54.309510 9436 tablet_loader.cc:96] loaded metadata for tablet 675413dc550f485dbef0d180ed27ff0e (table default.table_4ab72ecdb6d540508f6f4b250020b540 [id=0c4867ea1c1e45f388ccd4e2c9de093e])
I20260620 14:47:54.309846 9436 tablet_loader.cc:96] loaded metadata for tablet 73a17f00358f415d8b72a53859963eac (table default.table_7911231c2bcb420ebe8f3e12604c29e4 [id=76fec3007aa94f71867761f887e9b73e])
I20260620 14:47:54.310191 9436 tablet_loader.cc:96] loaded metadata for tablet 753328bb98be4189abdbf6d60ef95fc9 (table default.table_98318448fcf3484cb76812dad2975098 [id=862dd3cee25c40eead9feb394a8b58b1])
I20260620 14:47:54.310527 9436 tablet_loader.cc:96] loaded metadata for tablet 77320ec0783e43c2817b0ff16134915e (table default.table_154fc524efb24453bdb6d735e4c741e9 [id=3b08ae3b47fd46cab8ef5a41bb0bc5d7])
I20260620 14:47:54.311312 9436 tablet_loader.cc:96] loaded metadata for tablet 7a78d61e26c645b6bd82b6070c677b98 (table default.table_d2959bb621be429eb5af827263887798 [id=ddb41391569b4a11b4ad85335ca24ddb])
I20260620 14:47:54.311642 9436 tablet_loader.cc:96] loaded metadata for tablet 8caaa1b5e0384a6ab49b9fd7162896c8 (table default.table_bb493f9370e74bafae7b1e42f5c5f770 [id=6a722b39b30e45649b7b70c32c9e2260])
I20260620 14:47:54.311969 9436 tablet_loader.cc:96] loaded metadata for tablet a4552c4e15464f21a10b6c2d83f7ead8 (table default.table_e8372b71bacb4865b4360a50af59d323 [id=9c1e21a6c9244efba2e86bfa28264a0d])
I20260620 14:47:54.312500 9436 tablet_loader.cc:96] loaded metadata for tablet bd541e6a431348c7a506611681730fc5 (table default.table_a901d915c377429a9e43cfcaf071e7d3 [id=c65e926af55d4fbba6c42f4d2ddbb397])
I20260620 14:47:54.313259 9436 tablet_loader.cc:96] loaded metadata for tablet c4e5daabb2954a6f955fd4857b362884 (table default.table_8cc72697ee4f4200a5f57a19280315ee [id=1db81c7e90894c5fac0e8fe34d1d4441])
I20260620 14:47:54.313606 9436 tablet_loader.cc:96] loaded metadata for tablet cfb843392987415ca86f344e28de15a5 (table default.table_105950e097bf4cbda12e7532557966b2 [id=34076de884f942fcb696a9c9524941e7])
I20260620 14:47:54.314353 9436 tablet_loader.cc:96] loaded metadata for tablet eb6d101c1a5444cabf7c966c7ac7134e (table default.table_fe5ad6a8d59b4751bcbb6e1d0d4baedb [id=c514aca79062490a8b6a18021b07b2ff])
I20260620 14:47:54.315062 9436 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:47:54.316527 9436 catalog_manager.cc:1259] Loaded cluster ID: 700994c053c643c896af12c77a108604
I20260620 14:47:54.316607 9436 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:47:54.318397 9436 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:47:54.319625 9436 catalog_manager.cc:5879] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52: Loaded TSK: 0
I20260620 14:47:54.320428 9436 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 14:47:54.321691 9436 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260620 14:47:54.322768 9436 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: 27
I20260620 14:47:54.338035 8322 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59860:
name: "default.Table_63c7519d9a2a45b980b2d44a70aec200"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:54.338039 8331 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59860:
name: "default.Table_4f7f7c8b2fa84940bcb443efbbded490"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:54.338160 8323 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59860:
name: "default.Table_96a3abe199c94222aea451130599b401"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:54.338708 8328 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59860:
name: "default.Table_34a7935bc68a42c3aa8f0c43b09b30a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:54.338780 8330 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59860:
name: "default.Table_9d59fa2b31544f17b044945d2a45a612"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:54.339152 8327 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59860:
table { table_name: "default.Table_bb493f9370e74bafae7b1e42f5c5f770" } modify_external_catalogs: true
I20260620 14:47:54.339419 8327 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59860:
table { table_name: "default.Table_bb493f9370e74bafae7b1e42f5c5f770" } modify_external_catalogs: true
I20260620 14:47:54.339919 8326 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59860:
name: "default.Table_2d00c2dfdbfe428a8de80587e6f6e918"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:54.339977 8325 master_service.cc:946] ReplaceTablet: received request to replace tablet cfb843392987415ca86f344e28de15a5 from {username='slave'} at 127.0.0.1:59860
I20260620 14:47:54.340286 8329 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59860:
name: "default.Table_13f389c96bd0448091e94f5127394533"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:54.340811 8324 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59860:
name: "default.Table_ce174d6c98a242ab9c1ea68d35bd8c28"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:54.343845 8480 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 3 FOLLOWER]: Refusing update from remote peer dd308569015348a7a19ba4a560de6d52: Log matching property violated. Preceding OpId in replica: term: 2 index: 91. Preceding OpId from leader: term: 3 index: 93. (index mismatch)
I20260620 14:47:54.344556 9435 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 92, Last known committed idx: 90, Time since last communication: 0.000s
I20260620 14:47:54.344898 8527 catalog_manager.cc:2709] Deleting table default.table_2d00c2dfdbfe428a8de80587e6f6e918 [id=a17882ca0acc459caae49f8238c7df14] in response to Hive Metastore notification log event 28
W20260620 14:47:54.345221 8527 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 28 DROP_TABLE default.table_2d00c2dfdbfe428a8de80587e6f6e918: Not found: the table does not exist: table_id: "a17882ca0acc459caae49f8238c7df14" table_name: "default.table_2d00c2dfdbfe428a8de80587e6f6e918"
F20260620 14:47:54.345306 8527 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 28): 28 CREATE_TABLE default.table_154fc524efb24453bdb6d735e4c741e9
*** Check failure stack trace: ***
W20260620 14:47:54.346096 8317 consensus_peers.cc:487] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 -> Peer caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209): Couldn't send request to peer caa9dcf251944f7d97f4ed7f3d83af44. Status: Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
@ 0x7f92989589ad google::LogMessage::Fail() at ??:0
I20260620 14:47:54.348191 9428 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd308569015348a7a19ba4a560de6d52. Latest consensus state: current_term: 3 leader_uuid: "dd308569015348a7a19ba4a560de6d52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:54.348526 9428 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f929895b88a google::LogMessage::SendToLog() at ??:0
I20260620 14:47:54.351004 9428 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "dd308569015348a7a19ba4a560de6d52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:54.351270 9428 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f92989584de google::LogMessage::Flush() at ??:0
I20260620 14:47:54.352196 9431 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "dd308569015348a7a19ba4a560de6d52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:54.352567 9431 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: This master's current role is: LEADER
I20260620 14:47:54.353070 8325 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52: Sending DeleteTablet for 3 replicas of tablet cfb843392987415ca86f344e28de15a5
I20260620 14:47:54.353540 8325 catalog_manager.cc:6565] ReplaceTablet: tablet cfb843392987415ca86f344e28de15a5 deleted and replaced by tablet 8e2d76b1afb147088869a6180d5bc03e
I20260620 14:47:54.353919 8325 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59860:
table { table_name: "default.Table_105950e097bf4cbda12e7532557966b2" } modify_external_catalogs: true
I20260620 14:47:54.354158 8325 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59860:
table { table_name: "default.Table_105950e097bf4cbda12e7532557966b2" } modify_external_catalogs: true
I20260620 14:47:54.354843 8914 tablet_service.cc:1514] Processing DeleteTablet for tablet cfb843392987415ca86f344e28de15a5 with delete_type TABLET_DATA_DELETED (replaced by tablet 8e2d76b1afb147088869a6180d5bc03e) from {username='slave'} at 127.0.0.1:56438
I20260620 14:47:54.354933 8637 tablet_service.cc:1514] Processing DeleteTablet for tablet cfb843392987415ca86f344e28de15a5 with delete_type TABLET_DATA_DELETED (replaced by tablet 8e2d76b1afb147088869a6180d5bc03e) from {username='slave'} at 127.0.0.1:52276
@ 0x7f92989586d1 google::LogMessage::~LogMessage() at ??:0
I20260620 14:47:54.357721 8777 tablet_service.cc:1514] Processing DeleteTablet for tablet cfb843392987415ca86f344e28de15a5 with delete_type TABLET_DATA_DELETED (replaced by tablet 8e2d76b1afb147088869a6180d5bc03e) from {username='slave'} at 127.0.0.1:49700
I20260620 14:47:54.361294 9234 consensus_queue.cc:1035] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
@ 0x7f92ae4f6ba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260620 14:47:54.369751 9228 consensus_queue.cc:1035] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
@ 0x7f92ae4f5901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260620 14:47:54.373404 8913 tablet_service.cc:1467] Processing CreateTablet for tablet 1c65081e59334f90839952e5d1eda960 (DEFAULT_TABLE table=default.table_1ea7c21a49a443c29bd5578c5950c27f [id=bfa17da52a874fa1b587ad18d04cd740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:54.373857 8913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c65081e59334f90839952e5d1eda960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:54.374022 8776 tablet_service.cc:1467] Processing CreateTablet for tablet 1c65081e59334f90839952e5d1eda960 (DEFAULT_TABLE table=default.table_1ea7c21a49a443c29bd5578c5950c27f [id=bfa17da52a874fa1b587ad18d04cd740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:54.374138 9445 tablet_replica.cc:330] T cfb843392987415ca86f344e28de15a5 P c0e6c57ab91e42bf9be3739c816916c0: stopping tablet replica
I20260620 14:47:54.374366 9445 raft_consensus.cc:2229] T cfb843392987415ca86f344e28de15a5 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:54.374491 8776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c65081e59334f90839952e5d1eda960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:54.374573 9445 raft_consensus.cc:2258] T cfb843392987415ca86f344e28de15a5 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:54.375056 9444 tablet_replica.cc:330] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4: stopping tablet replica
I20260620 14:47:54.375245 9444 raft_consensus.cc:2229] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:47:54.375568 9444 raft_consensus.cc:2258] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:54.376392 9444 ts_tablet_manager.cc:1905] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:54.378182 8641 tablet_service.cc:1467] Processing CreateTablet for tablet 8e2d76b1afb147088869a6180d5bc03e (DEFAULT_TABLE table=default.table_105950e097bf4cbda12e7532557966b2 [id=34076de884f942fcb696a9c9524941e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:54.378597 8641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e2d76b1afb147088869a6180d5bc03e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:54.381129 8780 tablet_service.cc:1467] Processing CreateTablet for tablet 8e2d76b1afb147088869a6180d5bc03e (DEFAULT_TABLE table=default.table_105950e097bf4cbda12e7532557966b2 [id=34076de884f942fcb696a9c9524941e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:54.381618 8780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e2d76b1afb147088869a6180d5bc03e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:54.386967 8638 tablet_service.cc:1467] Processing CreateTablet for tablet 1c65081e59334f90839952e5d1eda960 (DEFAULT_TABLE table=default.table_1ea7c21a49a443c29bd5578c5950c27f [id=bfa17da52a874fa1b587ad18d04cd740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:54.387425 8638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c65081e59334f90839952e5d1eda960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:54.388427 9328 tablet_bootstrap.cc:492] T 1c65081e59334f90839952e5d1eda960 P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:54.390702 9328 tablet_bootstrap.cc:654] T 1c65081e59334f90839952e5d1eda960 P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:54.393702 8914 tablet_service.cc:1467] Processing CreateTablet for tablet 8e2d76b1afb147088869a6180d5bc03e (DEFAULT_TABLE table=default.table_105950e097bf4cbda12e7532557966b2 [id=34076de884f942fcb696a9c9524941e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:47:54.394083 8914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e2d76b1afb147088869a6180d5bc03e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:47:54.404189 9452 tablet_bootstrap.cc:492] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:54.406068 9452 tablet_bootstrap.cc:654] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:54.409246 9451 tablet_bootstrap.cc:492] T 1c65081e59334f90839952e5d1eda960 P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:54.409300 9446 tablet_replica.cc:330] T cfb843392987415ca86f344e28de15a5 P 36236dd5bd604ba2819038e525a3790c: stopping tablet replica
I20260620 14:47:54.409520 9446 raft_consensus.cc:2229] T cfb843392987415ca86f344e28de15a5 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:54.410043 9445 ts_tablet_manager.cc:1905] T cfb843392987415ca86f344e28de15a5 P c0e6c57ab91e42bf9be3739c816916c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:54.410929 9446 raft_consensus.cc:2258] T cfb843392987415ca86f344e28de15a5 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:54.411744 9446 ts_tablet_manager.cc:1905] T cfb843392987415ca86f344e28de15a5 P 36236dd5bd604ba2819038e525a3790c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:54.411900 9451 tablet_bootstrap.cc:654] T 1c65081e59334f90839952e5d1eda960 P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:54.413975 9328 tablet_bootstrap.cc:492] T 1c65081e59334f90839952e5d1eda960 P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
@ 0x7f92ae4fc66c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260620 14:47:54.414175 9328 ts_tablet_manager.cc:1397] T 1c65081e59334f90839952e5d1eda960 P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.005s
I20260620 14:47:54.415170 9328 raft_consensus.cc:348] T 1c65081e59334f90839952e5d1eda960 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:54.415437 9328 raft_consensus.cc:374] T 1c65081e59334f90839952e5d1eda960 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:54.415530 9328 raft_consensus.cc:729] T 1c65081e59334f90839952e5d1eda960 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:54.415786 9328 consensus_queue.cc:260] T 1c65081e59334f90839952e5d1eda960 P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:54.416486 9328 ts_tablet_manager.cc:1428] T 1c65081e59334f90839952e5d1eda960 P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 14:47:54.419209 9452 tablet_bootstrap.cc:492] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:54.419406 9452 ts_tablet_manager.cc:1397] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.005s
@ 0x7f92ae4fc4e9 std::_Function_handler<>::_M_invoke() at ??:0
I20260620 14:47:54.420166 9452 raft_consensus.cc:348] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:54.420437 9452 raft_consensus.cc:374] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:54.420558 9452 raft_consensus.cc:729] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:54.420846 9452 consensus_queue.cc:260] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:54.422499 9452 ts_tablet_manager.cc:1428] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
@ 0x9edb7d std::function<>::operator()() at ??:?
I20260620 14:47:54.423591 9452 tablet_bootstrap.cc:492] T 8e2d76b1afb147088869a6180d5bc03e P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:47:54.425263 9452 tablet_bootstrap.cc:654] T 8e2d76b1afb147088869a6180d5bc03e P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:54.427965 9452 tablet_bootstrap.cc:492] T 8e2d76b1afb147088869a6180d5bc03e P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:47:54.428107 9452 ts_tablet_manager.cc:1397] T 8e2d76b1afb147088869a6180d5bc03e P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
@ 0x7f929b582eaf kudu::Thread::SuperviseThread() at ??:0
I20260620 14:47:54.429370 9452 raft_consensus.cc:348] T 8e2d76b1afb147088869a6180d5bc03e P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:54.429610 9452 raft_consensus.cc:374] T 8e2d76b1afb147088869a6180d5bc03e P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:54.429692 9452 raft_consensus.cc:729] T 8e2d76b1afb147088869a6180d5bc03e P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:47:54.429966 9452 consensus_queue.cc:260] T 8e2d76b1afb147088869a6180d5bc03e P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:54.431531 9452 ts_tablet_manager.cc:1428] T 8e2d76b1afb147088869a6180d5bc03e P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260620 14:47:54.432101 9451 tablet_bootstrap.cc:492] T 1c65081e59334f90839952e5d1eda960 P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:54.432256 9451 ts_tablet_manager.cc:1397] T 1c65081e59334f90839952e5d1eda960 P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.013s
@ 0x7f929e85c6db start_thread at ??:0
I20260620 14:47:54.433233 9451 raft_consensus.cc:348] T 1c65081e59334f90839952e5d1eda960 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:54.433533 9451 raft_consensus.cc:374] T 1c65081e59334f90839952e5d1eda960 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:54.433624 9451 raft_consensus.cc:729] T 1c65081e59334f90839952e5d1eda960 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:54.433881 9451 consensus_queue.cc:260] T 1c65081e59334f90839952e5d1eda960 P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
@ 0x7f92977f261f clone at ??:0
I20260620 14:47:54.434618 9451 ts_tablet_manager.cc:1428] T 1c65081e59334f90839952e5d1eda960 P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 14:47:54.435261 9451 tablet_bootstrap.cc:492] T 8e2d76b1afb147088869a6180d5bc03e P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:47:54.437249 9451 tablet_bootstrap.cc:654] T 8e2d76b1afb147088869a6180d5bc03e P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:54.440793 9451 tablet_bootstrap.cc:492] T 8e2d76b1afb147088869a6180d5bc03e P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:47:54.441044 9451 ts_tablet_manager.cc:1397] T 8e2d76b1afb147088869a6180d5bc03e P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.001s
I20260620 14:47:54.441881 9451 raft_consensus.cc:348] T 8e2d76b1afb147088869a6180d5bc03e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:54.442154 9451 raft_consensus.cc:374] T 8e2d76b1afb147088869a6180d5bc03e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:54.442237 9451 raft_consensus.cc:729] T 8e2d76b1afb147088869a6180d5bc03e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:47:54.442466 9451 consensus_queue.cc:260] T 8e2d76b1afb147088869a6180d5bc03e P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:54.443045 9451 ts_tablet_manager.cc:1428] T 8e2d76b1afb147088869a6180d5bc03e P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 14:47:54.488615 9328 tablet_bootstrap.cc:492] T 8e2d76b1afb147088869a6180d5bc03e P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:47:54.490327 9328 tablet_bootstrap.cc:654] T 8e2d76b1afb147088869a6180d5bc03e P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:47:54.491401 9444 ts_tablet_manager.cc:1918] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:54.491531 9444 log.cc:1196] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal/wals/cfb843392987415ca86f344e28de15a5
I20260620 14:47:54.491911 9444 ts_tablet_manager.cc:1939] T cfb843392987415ca86f344e28de15a5 P 6c99207e35f8463292d71c371c9546b4: Deleting consensus metadata
I20260620 14:47:54.493300 9328 tablet_bootstrap.cc:492] T 8e2d76b1afb147088869a6180d5bc03e P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:47:54.493494 9328 ts_tablet_manager.cc:1397] T 8e2d76b1afb147088869a6180d5bc03e P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260620 14:47:54.494277 9328 raft_consensus.cc:348] T 8e2d76b1afb147088869a6180d5bc03e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:54.494552 9328 raft_consensus.cc:374] T 8e2d76b1afb147088869a6180d5bc03e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:47:54.494676 9328 raft_consensus.cc:729] T 8e2d76b1afb147088869a6180d5bc03e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:47:54.494971 9328 consensus_queue.cc:260] T 8e2d76b1afb147088869a6180d5bc03e P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:54.495767 9328 ts_tablet_manager.cc:1428] T 8e2d76b1afb147088869a6180d5bc03e P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260620 14:47:54.583288 9408 consensus_queue.cc:1035] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:54.583835 9445 ts_tablet_manager.cc:1918] T cfb843392987415ca86f344e28de15a5 P c0e6c57ab91e42bf9be3739c816916c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:54.583983 9445 log.cc:1196] T cfb843392987415ca86f344e28de15a5 P c0e6c57ab91e42bf9be3739c816916c0: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/wal/wals/cfb843392987415ca86f344e28de15a5
I20260620 14:47:54.584447 9445 ts_tablet_manager.cc:1939] T cfb843392987415ca86f344e28de15a5 P c0e6c57ab91e42bf9be3739c816916c0: Deleting consensus metadata
I20260620 14:47:54.585146 9446 ts_tablet_manager.cc:1918] T cfb843392987415ca86f344e28de15a5 P 36236dd5bd604ba2819038e525a3790c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:54.585350 9446 log.cc:1196] T cfb843392987415ca86f344e28de15a5 P 36236dd5bd604ba2819038e525a3790c: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal/wals/cfb843392987415ca86f344e28de15a5
I20260620 14:47:54.585856 9446 ts_tablet_manager.cc:1939] T cfb843392987415ca86f344e28de15a5 P 36236dd5bd604ba2819038e525a3790c: Deleting consensus metadata
I20260620 14:47:54.594372 9468 consensus_queue.cc:1035] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:54.616518 9468 consensus_queue.cc:1035] T 7a78d61e26c645b6bd82b6070c677b98 P c0e6c57ab91e42bf9be3739c816916c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:54.624676 9468 consensus_queue.cc:1035] T 7a78d61e26c645b6bd82b6070c677b98 P c0e6c57ab91e42bf9be3739c816916c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260620 14:47:54.647372 8987 connection.cc:535] client connection to 127.7.222.254:39515 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 14:47:54.647367 8868 connection.cc:535] server connection from 127.0.0.1:56438 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 14:47:54.649354 8732 connection.cc:535] server connection from 127.0.0.1:49700 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 14:47:54.650089 9425 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:47:54.648339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.222.254:39515 (local address 127.7.222.194:45439)
0620 14:47:54.649531 (+ 1192us) negotiation.cc:107] Waiting for socket to connect
0620 14:47:54.649555 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0620 14:47:54.649675 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:47:54.649881 (+ 206us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: BlockingWrite error: write error: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":1059}
W20260620 14:47:54.650955 8597 connection.cc:535] server connection from 127.0.0.1:52276 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 14:47:54.651194 9426 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:47:54.648387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.222.254:39515 (local address 127.7.222.195:57129)
0620 14:47:54.648670 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0620 14:47:54.648692 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0620 14:47:54.648846 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0620 14:47:54.650121 (+ 1275us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":132}
I20260620 14:47:54.854733 9228 raft_consensus.cc:482] T 2b45f60882664099b090170903fe74b2 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:54.854861 9234 raft_consensus.cc:482] T 8e2d76b1afb147088869a6180d5bc03e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:54.855006 9234 raft_consensus.cc:504] T 8e2d76b1afb147088869a6180d5bc03e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:54.855005 9228 raft_consensus.cc:504] T 2b45f60882664099b090170903fe74b2 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:47:54.855720 9234 leader_election.cc:288] T 8e2d76b1afb147088869a6180d5bc03e P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:54.855796 9228 leader_election.cc:288] T 2b45f60882664099b090170903fe74b2 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:47:54.856406 8662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2d76b1afb147088869a6180d5bc03e" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:47:54.856590 8798 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2d76b1afb147088869a6180d5bc03e" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:47:54.856705 8662 raft_consensus.cc:2454] T 8e2d76b1afb147088869a6180d5bc03e P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:54.856791 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b45f60882664099b090170903fe74b2" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:47:54.856443 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b45f60882664099b090170903fe74b2" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:47:54.856951 8798 raft_consensus.cc:2454] T 8e2d76b1afb147088869a6180d5bc03e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:47:54.857101 8659 raft_consensus.cc:2379] T 2b45f60882664099b090170903fe74b2 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c99207e35f8463292d71c371c9546b4 in current term 1: Already voted for candidate 36236dd5bd604ba2819038e525a3790c in this term.
I20260620 14:47:54.857484 8871 leader_election.cc:302] T 8e2d76b1afb147088869a6180d5bc03e P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4; no voters:
I20260620 14:47:54.857754 8869 leader_election.cc:302] T 2b45f60882664099b090170903fe74b2 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4; no voters: 36236dd5bd604ba2819038e525a3790c, c0e6c57ab91e42bf9be3739c816916c0
I20260620 14:47:54.857872 9228 raft_consensus.cc:2781] T 8e2d76b1afb147088869a6180d5bc03e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:54.857972 9228 raft_consensus.cc:482] T 8e2d76b1afb147088869a6180d5bc03e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:54.858070 9228 raft_consensus.cc:3037] T 8e2d76b1afb147088869a6180d5bc03e P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:54.858260 9234 raft_consensus.cc:3037] T 2b45f60882664099b090170903fe74b2 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:54.863981 9471 raft_consensus.cc:482] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:54.864157 9471 raft_consensus.cc:504] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:54.865021 9471 leader_election.cc:288] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:47:54.865561 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c65081e59334f90839952e5d1eda960" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:47:54.865607 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c65081e59334f90839952e5d1eda960" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4" is_pre_election: true
I20260620 14:47:54.865828 8799 raft_consensus.cc:2454] T 1c65081e59334f90839952e5d1eda960 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 0.
I20260620 14:47:54.865847 8935 raft_consensus.cc:2454] T 1c65081e59334f90839952e5d1eda960 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 0.
I20260620 14:47:54.865921 9474 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dd308569015348a7a19ba4a560de6d52)
I20260620 14:47:54.866083 9474 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:54.866334 8598 leader_election.cc:302] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:54.866636 9471 raft_consensus.cc:2781] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:47:54.866782 9471 raft_consensus.cc:482] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:47:54.866849 9474 leader_election.cc:288] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209)
I20260620 14:47:54.867003 9471 raft_consensus.cc:3037] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
W20260620 14:47:54.867683 8455 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 14:47:54.868997 8455 leader_election.cc:334] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:47:54.869628 8457 leader_election.cc:334] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209): Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
I20260620 14:47:54.869786 8457 leader_election.cc:302] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61512e6d316d4d3a998e52511a0bba7a; no voters: caa9dcf251944f7d97f4ed7f3d83af44, dd308569015348a7a19ba4a560de6d52
I20260620 14:47:54.870023 9474 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 14:47:54.898556 9234 raft_consensus.cc:2726] T 2b45f60882664099b090170903fe74b2 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 14:47:54.898530 9471 raft_consensus.cc:504] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:54.898707 9228 raft_consensus.cc:504] T 8e2d76b1afb147088869a6180d5bc03e P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:54.899272 9471 leader_election.cc:288] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 election: Requested vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:47:54.899441 9228 leader_election.cc:288] T 8e2d76b1afb147088869a6180d5bc03e P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Requested vote from peers c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:54.899914 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c65081e59334f90839952e5d1eda960" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:47:54.900130 8799 raft_consensus.cc:3037] T 1c65081e59334f90839952e5d1eda960 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:54.900187 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c65081e59334f90839952e5d1eda960" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4"
I20260620 14:47:54.900391 8935 raft_consensus.cc:3037] T 1c65081e59334f90839952e5d1eda960 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:54.901103 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2d76b1afb147088869a6180d5bc03e" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:47:54.901300 8659 raft_consensus.cc:3037] T 8e2d76b1afb147088869a6180d5bc03e P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:54.902894 8799 raft_consensus.cc:2454] T 1c65081e59334f90839952e5d1eda960 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 1.
I20260620 14:47:54.903419 8598 leader_election.cc:302] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:54.903735 9471 raft_consensus.cc:2781] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:54.903901 9471 raft_consensus.cc:686] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 LEADER]: Becoming Leader. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Running, Role: LEADER
I20260620 14:47:54.904183 9471 consensus_queue.cc:237] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:54.904598 8798 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2d76b1afb147088869a6180d5bc03e" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:47:54.904835 8798 raft_consensus.cc:3037] T 8e2d76b1afb147088869a6180d5bc03e P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:47:54.939184 9054 consensus_queue.cc:1035] T 2b45f60882664099b090170903fe74b2 P 36236dd5bd604ba2819038e525a3790c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:54.947172 9487 consensus_queue.cc:1035] T 2b45f60882664099b090170903fe74b2 P 36236dd5bd604ba2819038e525a3790c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260620 14:47:54.953797 9228 consensus_queue.cc:1035] T 73a17f00358f415d8b72a53859963eac P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:54.961109 9228 consensus_queue.cc:1035] T 73a17f00358f415d8b72a53859963eac P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:54.998463 8659 raft_consensus.cc:2454] T 8e2d76b1afb147088869a6180d5bc03e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:54.998476 8935 raft_consensus.cc:2454] T 1c65081e59334f90839952e5d1eda960 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 1.
I20260620 14:47:54.999115 8798 raft_consensus.cc:2454] T 8e2d76b1afb147088869a6180d5bc03e P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:47:54.999557 8869 leader_election.cc:302] T 8e2d76b1afb147088869a6180d5bc03e P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:47:54.999966 9228 raft_consensus.cc:2781] T 8e2d76b1afb147088869a6180d5bc03e P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:47:55.000149 9228 raft_consensus.cc:686] T 8e2d76b1afb147088869a6180d5bc03e P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Becoming Leader. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Running, Role: LEADER
I20260620 14:47:55.000488 9228 consensus_queue.cc:237] T 8e2d76b1afb147088869a6180d5bc03e P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:55.080022 8059 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9VKlbC/build/asan/bin/kudu
/tmp/dist-test-task9VKlbC/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.222.253:34209
--webserver_interface=127.7.222.253
--webserver_port=40901
--builtin_ntp_servers=127.7.222.212:42755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--hive_metastore_uris=thrift://127.0.0.1:42797
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260620 14:47:55.437567 9494 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:47:55.437906 9494 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:47:55.438088 9494 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:47:55.446213 9494 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:47:55.446358 9494 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:47:55.446457 9494 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:47:55.446564 9494 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:47:55.457614 9494 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.222.212:42755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:42797
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.222.253:34209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.222.253
--webserver_port=40901
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 13:41:20 UTC on ccycloud.quasar-vdagoi.root.comops.site
build id 4457462
ASAN enabled
I20260620 14:47:55.459086 9494 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:47:55.461125 9494 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:47:55.477468 9500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:47:55.477439 9503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:47:55.477694 9501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:47:55.478793 9494 server_base.cc:1034] running on GCE node
I20260620 14:47:55.479725 9494 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:47:55.481369 9494 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:47:55.484726 9494 hybrid_clock.cc:648] HybridClock initialized: now 1781966875484646 us; error 73 us; skew 500 ppm
I20260620 14:47:55.485175 9494 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 14:47:55.487612 9494 webserver.cc:460] Webserver started at http://127.7.222.253:40901/ using document root <none> and password file <none>
I20260620 14:47:55.488430 9494 fs_manager.cc:359] Metadata directory not provided
I20260620 14:47:55.488581 9494 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:47:55.494328 9494 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.003s
I20260620 14:47:55.497576 9509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:47:55.499120 9510 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dd308569015348a7a19ba4a560de6d52)
I20260620 14:47:55.499343 9494 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260620 14:47:55.499303 9510 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:55.500072 9510 leader_election.cc:288] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209)
I20260620 14:47:55.499557 9494 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data,/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
uuid: "caa9dcf251944f7d97f4ed7f3d83af44"
format_stamp: "Formatted at 2026-06-20 14:47:46 on dist-test-slave-c599"
I20260620 14:47:55.501081 9494 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260620 14:47:55.502952 8455 leader_election.cc:334] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:47:55.503137 8457 leader_election.cc:334] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209): Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
I20260620 14:47:55.503285 8457 leader_election.cc:302] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61512e6d316d4d3a998e52511a0bba7a; no voters: caa9dcf251944f7d97f4ed7f3d83af44, dd308569015348a7a19ba4a560de6d52
I20260620 14:47:55.503518 9510 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260620 14:47:55.530112 9494 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:47:55.531023 9494 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:47:55.531332 9494 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:47:55.550364 9494 rpc_server.cc:307] RPC server started. Bound to: 127.7.222.253:34209
I20260620 14:47:55.550383 9564 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.222.253:34209 every 8 connection(s)
I20260620 14:47:55.552464 9494 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data/info.pb
I20260620 14:47:55.558977 8059 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9VKlbC/build/asan/bin/kudu as pid 9494
I20260620 14:47:55.561237 9565 sys_catalog.cc:263] Verifying existing consensus state
I20260620 14:47:55.566346 9565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Bootstrap starting.
I20260620 14:47:55.590237 9565 log.cc:824] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Log is configured to *not* fsync() on all Append() calls
I20260620 14:47:55.591555 8982 heartbeater.cc:347] Connected to a master server at 127.7.222.253:34209
I20260620 14:47:55.656718 9565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Bootstrap replayed 1/1 log segments. Stats: ops{read=91 overwritten=0 applied=90 ignored=0} inserts{seen=65 ignored=0} mutations{seen=75 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260620 14:47:55.657482 9565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Bootstrap complete.
I20260620 14:47:55.666242 9565 raft_consensus.cc:348] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:55.669617 9565 raft_consensus.cc:729] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa9dcf251944f7d97f4ed7f3d83af44, State: Initialized, Role: FOLLOWER
I20260620 14:47:55.670347 9565 consensus_queue.cc:260] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 90, Last appended: 2.91, Last appended by leader: 91, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:55.671255 9574 sys_catalog.cc:455] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:55.671623 9574 sys_catalog.cc:458] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:47:55.672348 9565 sys_catalog.cc:564] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:47:55.683571 9494 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:47:55.692641 9494 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:47:55.697144 9588 catalog_manager.cc:1259] Loaded cluster ID: 700994c053c643c896af12c77a108604
I20260620 14:47:55.697258 9588 catalog_manager.cc:1552] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: loading cluster ID for follower catalog manager: success
I20260620 14:47:55.702113 9588 catalog_manager.cc:1574] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: acquiring CA information for follower catalog manager: success
I20260620 14:47:55.705950 9588 catalog_manager.cc:1602] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 14:47:55.773545 9471 consensus_queue.cc:1035] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:55.776626 8982 heartbeater.cc:347] Connected to a master server at 127.7.222.253:34209
I20260620 14:47:55.793210 9530 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6c99207e35f8463292d71c371c9546b4" instance_seqno: 1781966868961030) as {username='slave'} at 127.7.222.195:52147; Asking this server to re-register.
I20260620 14:47:55.794554 8982 heartbeater.cc:464] Registering TS with master...
I20260620 14:47:55.797494 9528 ts_manager.cc:194] Registered new tserver with Master: 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:47:55.800973 9471 consensus_queue.cc:1035] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:55.822332 8709 heartbeater.cc:347] Connected to a master server at 127.7.222.253:34209
I20260620 14:47:55.824607 9530 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" instance_seqno: 1781966867942712) as {username='slave'} at 127.7.222.193:60979; Asking this server to re-register.
I20260620 14:47:55.825448 8709 heartbeater.cc:464] Registering TS with master...
I20260620 14:47:55.827375 9530 ts_manager.cc:194] Registered new tserver with Master: c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:47:55.828332 8847 heartbeater.cc:347] Connected to a master server at 127.7.222.253:34209
I20260620 14:47:55.834256 9530 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "36236dd5bd604ba2819038e525a3790c" instance_seqno: 1781966868431821) as {username='slave'} at 127.7.222.194:55773; Asking this server to re-register.
I20260620 14:47:55.834970 8847 heartbeater.cc:464] Registering TS with master...
I20260620 14:47:55.836947 9530 ts_manager.cc:194] Registered new tserver with Master: 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:47:56.066267 9574 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:56.066627 9574 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:56.068878 9574 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:47:56.070704 9514 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:47:56.074043 9514 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:47:56.079103 8480 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" candidate_term: 3 candidate_status { last_received { term: 2 index: 91 } } ignore_live_leader: false dest_uuid: "61512e6d316d4d3a998e52511a0bba7a" is_pre_election: true
I20260620 14:47:56.079496 8480 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate caa9dcf251944f7d97f4ed7f3d83af44 in current term 3: Already voted for candidate dd308569015348a7a19ba4a560de6d52 in this term.
I20260620 14:47:56.080461 9517 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:47:56.080889 9574 raft_consensus.cc:3037] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 2 FOLLOWER]: Advancing to term 3
I20260620 14:47:56.128671 9574 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260620 14:47:56.137404 9601 consensus_queue.cc:1035] T 8e2d76b1afb147088869a6180d5bc03e P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:56.142946 9228 consensus_queue.cc:1035] T 8e2d76b1afb147088869a6180d5bc03e P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:47:56.435763 9611 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dd308569015348a7a19ba4a560de6d52)
I20260620 14:47:56.436005 9611 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:56.436739 9611 leader_election.cc:288] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209)
W20260620 14:47:56.439038 8455 leader_election.cc:334] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:47:56.444329 9540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "61512e6d316d4d3a998e52511a0bba7a" candidate_term: 4 candidate_status { last_received { term: 3 index: 94 } } ignore_live_leader: false dest_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" is_pre_election: true
I20260620 14:47:56.444840 9540 raft_consensus.cc:2454] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61512e6d316d4d3a998e52511a0bba7a in term 3.
I20260620 14:47:56.445356 8457 leader_election.cc:302] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61512e6d316d4d3a998e52511a0bba7a, caa9dcf251944f7d97f4ed7f3d83af44; no voters: dd308569015348a7a19ba4a560de6d52
I20260620 14:47:56.445657 9611 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260620 14:47:56.445787 9611 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 3 FOLLOWER]: Starting leader election (detected failure of leader dd308569015348a7a19ba4a560de6d52)
I20260620 14:47:56.445868 9611 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 3 FOLLOWER]: Advancing to term 4
I20260620 14:47:56.535544 9611 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:56.537031 9540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "61512e6d316d4d3a998e52511a0bba7a" candidate_term: 4 candidate_status { last_received { term: 3 index: 94 } } ignore_live_leader: false dest_uuid: "caa9dcf251944f7d97f4ed7f3d83af44"
I20260620 14:47:56.537281 9540 raft_consensus.cc:3037] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 3 FOLLOWER]: Advancing to term 4
I20260620 14:47:56.538260 9611 leader_election.cc:288] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 4 election: Requested vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209)
W20260620 14:47:56.538880 8455 leader_election.cc:334] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:47:56.539844 9540 raft_consensus.cc:2454] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61512e6d316d4d3a998e52511a0bba7a in term 4.
I20260620 14:47:56.540320 8457 leader_election.cc:302] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61512e6d316d4d3a998e52511a0bba7a, caa9dcf251944f7d97f4ed7f3d83af44; no voters: dd308569015348a7a19ba4a560de6d52
I20260620 14:47:56.540647 9611 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 4 FOLLOWER]: Leader election won for term 4
I20260620 14:47:56.541133 9611 raft_consensus.cc:686] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 4 LEADER]: Becoming Leader. State: Replica: 61512e6d316d4d3a998e52511a0bba7a, State: Running, Role: LEADER
I20260620 14:47:56.541563 9611 consensus_queue.cc:237] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 94, Committed index: 94, Last appended: 3.94, Last appended by leader: 94, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:56.543200 9616 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61512e6d316d4d3a998e52511a0bba7a. Latest consensus state: current_term: 4 leader_uuid: "61512e6d316d4d3a998e52511a0bba7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:56.543574 9616 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: This master's current role is: LEADER
I20260620 14:47:56.544178 9618 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:47:56.546952 9618 catalog_manager.cc:669] Loaded metadata for table default.table_4ab72ecdb6d540508f6f4b250020b540 [id=0c4867ea1c1e45f388ccd4e2c9de093e]
I20260620 14:47:56.547494 9618 catalog_manager.cc:669] Loaded metadata for table default.table_8cc72697ee4f4200a5f57a19280315ee [id=1db81c7e90894c5fac0e8fe34d1d4441]
I20260620 14:47:56.547817 9618 catalog_manager.cc:669] Loaded metadata for table default.table_105950e097bf4cbda12e7532557966b2 [id=34076de884f942fcb696a9c9524941e7]
I20260620 14:47:56.548137 9618 catalog_manager.cc:669] Loaded metadata for table default.table_0eb776233cee4294b6c96ec556447663 [id=3420fc1c9c8b45f49aeaa7b4c97da51e]
I20260620 14:47:56.548501 9618 catalog_manager.cc:669] Loaded metadata for table default.table_154fc524efb24453bdb6d735e4c741e9 [id=3b08ae3b47fd46cab8ef5a41bb0bc5d7]
I20260620 14:47:56.548902 9618 catalog_manager.cc:669] Loaded metadata for table default.table_bb493f9370e74bafae7b1e42f5c5f770 [id=6a722b39b30e45649b7b70c32c9e2260]
I20260620 14:47:56.549225 9618 catalog_manager.cc:669] Loaded metadata for table default.table_7911231c2bcb420ebe8f3e12604c29e4 [id=76fec3007aa94f71867761f887e9b73e]
I20260620 14:47:56.549597 9618 catalog_manager.cc:669] Loaded metadata for table default.table_16339630485f49f6a8bb2b71981cdeb1 [id=7d2156b55c1349b2841c1d2676f74993]
I20260620 14:47:56.550014 9618 catalog_manager.cc:669] Loaded metadata for table default.table_563392802bec4e688c0eabd46ab1fd5c [id=7e71694fb4a948f09c01863575227fda]
I20260620 14:47:56.550582 9618 catalog_manager.cc:669] Loaded metadata for table default.table_fdbead99862d49af98df44683e830bf5 [id=85b633c4801d49bd9ad9b944b178e683]
I20260620 14:47:56.550972 9618 catalog_manager.cc:669] Loaded metadata for table default.table_98318448fcf3484cb76812dad2975098 [id=862dd3cee25c40eead9feb394a8b58b1]
I20260620 14:47:56.551360 9618 catalog_manager.cc:669] Loaded metadata for table default.table_19c624001d444b7b9939e22128c594aa [id=98d2e7b647544a97b50827a0cb2799a0]
I20260620 14:47:56.551733 9618 catalog_manager.cc:669] Loaded metadata for table default.table_e8372b71bacb4865b4360a50af59d323 [id=9c1e21a6c9244efba2e86bfa28264a0d]
I20260620 14:47:56.552321 9618 catalog_manager.cc:669] Loaded metadata for table default.table_1ea7c21a49a443c29bd5578c5950c27f [id=bfa17da52a874fa1b587ad18d04cd740]
I20260620 14:47:56.552728 9618 catalog_manager.cc:669] Loaded metadata for table default.table_fe5ad6a8d59b4751bcbb6e1d0d4baedb [id=c514aca79062490a8b6a18021b07b2ff]
I20260620 14:47:56.553205 9618 catalog_manager.cc:669] Loaded metadata for table default.table_a901d915c377429a9e43cfcaf071e7d3 [id=c65e926af55d4fbba6c42f4d2ddbb397]
I20260620 14:47:56.553570 9618 catalog_manager.cc:669] Loaded metadata for table default.table_d2959bb621be429eb5af827263887798 [id=ddb41391569b4a11b4ad85335ca24ddb]
I20260620 14:47:56.556583 9618 tablet_loader.cc:96] loaded metadata for tablet 1ad679f398ab41a1bc207b016648cbe8 (table default.table_19c624001d444b7b9939e22128c594aa [id=98d2e7b647544a97b50827a0cb2799a0])
I20260620 14:47:56.557035 9618 tablet_loader.cc:96] loaded metadata for tablet 1c65081e59334f90839952e5d1eda960 (table default.table_1ea7c21a49a443c29bd5578c5950c27f [id=bfa17da52a874fa1b587ad18d04cd740])
I20260620 14:47:56.557564 9618 tablet_loader.cc:96] loaded metadata for tablet 26639d34678c4f77994cd44313b98898 (table default.table_16339630485f49f6a8bb2b71981cdeb1 [id=7d2156b55c1349b2841c1d2676f74993])
I20260620 14:47:56.557880 9618 tablet_loader.cc:96] loaded metadata for tablet 2b45f60882664099b090170903fe74b2 (table default.table_0eb776233cee4294b6c96ec556447663 [id=3420fc1c9c8b45f49aeaa7b4c97da51e])
I20260620 14:47:56.558387 9618 tablet_loader.cc:96] loaded metadata for tablet 309a0915648643ada08981a11e7a1e59 (table default.table_563392802bec4e688c0eabd46ab1fd5c [id=7e71694fb4a948f09c01863575227fda])
I20260620 14:47:56.559068 9618 tablet_loader.cc:96] loaded metadata for tablet 493a30104eab4762a3f4ffae3491765e (table default.table_fdbead99862d49af98df44683e830bf5 [id=85b633c4801d49bd9ad9b944b178e683])
I20260620 14:47:56.560017 9618 tablet_loader.cc:96] loaded metadata for tablet 675413dc550f485dbef0d180ed27ff0e (table default.table_4ab72ecdb6d540508f6f4b250020b540 [id=0c4867ea1c1e45f388ccd4e2c9de093e])
I20260620 14:47:56.560313 9618 tablet_loader.cc:96] loaded metadata for tablet 73a17f00358f415d8b72a53859963eac (table default.table_7911231c2bcb420ebe8f3e12604c29e4 [id=76fec3007aa94f71867761f887e9b73e])
I20260620 14:47:56.560627 9618 tablet_loader.cc:96] loaded metadata for tablet 753328bb98be4189abdbf6d60ef95fc9 (table default.table_98318448fcf3484cb76812dad2975098 [id=862dd3cee25c40eead9feb394a8b58b1])
I20260620 14:47:56.560941 9618 tablet_loader.cc:96] loaded metadata for tablet 77320ec0783e43c2817b0ff16134915e (table default.table_154fc524efb24453bdb6d735e4c741e9 [id=3b08ae3b47fd46cab8ef5a41bb0bc5d7])
I20260620 14:47:56.561642 9618 tablet_loader.cc:96] loaded metadata for tablet 7a78d61e26c645b6bd82b6070c677b98 (table default.table_d2959bb621be429eb5af827263887798 [id=ddb41391569b4a11b4ad85335ca24ddb])
I20260620 14:47:56.561937 9618 tablet_loader.cc:96] loaded metadata for tablet 8caaa1b5e0384a6ab49b9fd7162896c8 (table default.table_bb493f9370e74bafae7b1e42f5c5f770 [id=6a722b39b30e45649b7b70c32c9e2260])
I20260620 14:47:56.562222 9618 tablet_loader.cc:96] loaded metadata for tablet 8e2d76b1afb147088869a6180d5bc03e (table default.table_105950e097bf4cbda12e7532557966b2 [id=34076de884f942fcb696a9c9524941e7])
I20260620 14:47:56.562511 9618 tablet_loader.cc:96] loaded metadata for tablet a4552c4e15464f21a10b6c2d83f7ead8 (table default.table_e8372b71bacb4865b4360a50af59d323 [id=9c1e21a6c9244efba2e86bfa28264a0d])
I20260620 14:47:56.563000 9618 tablet_loader.cc:96] loaded metadata for tablet bd541e6a431348c7a506611681730fc5 (table default.table_a901d915c377429a9e43cfcaf071e7d3 [id=c65e926af55d4fbba6c42f4d2ddbb397])
I20260620 14:47:56.563665 9618 tablet_loader.cc:96] loaded metadata for tablet c4e5daabb2954a6f955fd4857b362884 (table default.table_8cc72697ee4f4200a5f57a19280315ee [id=1db81c7e90894c5fac0e8fe34d1d4441])
I20260620 14:47:56.564493 9618 tablet_loader.cc:96] loaded metadata for tablet eb6d101c1a5444cabf7c966c7ac7134e (table default.table_fe5ad6a8d59b4751bcbb6e1d0d4baedb [id=c514aca79062490a8b6a18021b07b2ff])
I20260620 14:47:56.564864 9618 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:47:56.566857 9618 catalog_manager.cc:1259] Loaded cluster ID: 700994c053c643c896af12c77a108604
I20260620 14:47:56.566947 9618 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:47:56.569289 9618 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:47:56.571070 9618 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: Loaded TSK: 0
I20260620 14:47:56.572211 9618 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 14:47:56.573987 9618 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260620 14:47:56.575979 9618 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: 27
I20260620 14:47:56.599161 8468 master_service.cc:946] ReplaceTablet: received request to replace tablet 1c65081e59334f90839952e5d1eda960 from {username='slave'} at 127.0.0.1:45198
I20260620 14:47:56.599494 8470 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45198:
table { table_name: "default.Table_fdbead99862d49af98df44683e830bf5" } new_table_name: "default.Table_d287e3d931c34a68ae38252d5c848e4c" modify_external_catalogs: true
I20260620 14:47:56.599800 8467 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45198:
table { table_name: "default.Table_1ea7c21a49a443c29bd5578c5950c27f" } new_table_name: "default.Table_2b02aaacb2204d27a2fa683065bccc6b" modify_external_catalogs: true
I20260620 14:47:56.600945 8471 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45198:
table { table_name: "default.Table_19c624001d444b7b9939e22128c594aa" } new_table_name: "default.Table_ed65359dea1b47aab601b55d6957c2dd" modify_external_catalogs: true
I20260620 14:47:56.601468 8465 master_service.cc:946] ReplaceTablet: received request to replace tablet 77320ec0783e43c2817b0ff16134915e from {username='slave'} at 127.0.0.1:45198
I20260620 14:47:56.601711 8463 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45198:
table { table_name: "default.Table_a901d915c377429a9e43cfcaf071e7d3" } modify_external_catalogs: true
I20260620 14:47:56.601991 8463 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45198:
table { table_name: "default.Table_a901d915c377429a9e43cfcaf071e7d3" } modify_external_catalogs: true
I20260620 14:47:56.601471 8469 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45198:
name: "default.Table_1d5a20c59b2741ca905b63fd9478cf1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:47:56.606844 8462 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45198:
table { table_name: "default.Table_98318448fcf3484cb76812dad2975098" } new_table_name: "default.Table_b4a1333c5cb24d1093488dce20083354" modify_external_catalogs: true
I20260620 14:47:56.606917 8464 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45198:
table { table_name: "default.Table_e8372b71bacb4865b4360a50af59d323" } new_table_name: "default.Table_0397b5018c12412d8adff6a6eef71ab4" modify_external_catalogs: true
I20260620 14:47:56.606873 8466 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45198:
table { table_name: "default.Table_0eb776233cee4294b6c96ec556447663" } modify_external_catalogs: true
I20260620 14:47:56.607414 9540 raft_consensus.cc:1261] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 4 FOLLOWER]: Refusing update from remote peer 61512e6d316d4d3a998e52511a0bba7a: Log matching property violated. Preceding OpId in replica: term: 2 index: 91. Preceding OpId from leader: term: 4 index: 96. (index mismatch)
I20260620 14:47:56.607465 8466 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45198:
table { table_name: "default.Table_0eb776233cee4294b6c96ec556447663" } modify_external_catalogs: true
I20260620 14:47:56.608945 9616 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 95, Last known committed idx: 90, Time since last communication: 0.000s
I20260620 14:47:56.611812 8545 catalog_manager.cc:2709] Deleting table default.table_2d00c2dfdbfe428a8de80587e6f6e918 [id=a17882ca0acc459caae49f8238c7df14] in response to Hive Metastore notification log event 28
W20260620 14:47:56.611809 8455 consensus_peers.cc:487] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a -> Peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Couldn't send request to peer dd308569015348a7a19ba4a560de6d52. Status: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260620 14:47:56.612254 8545 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 28 DROP_TABLE default.table_2d00c2dfdbfe428a8de80587e6f6e918: Not found: the table does not exist: table_id: "a17882ca0acc459caae49f8238c7df14" table_name: "default.table_2d00c2dfdbfe428a8de80587e6f6e918"
F20260620 14:47:56.612380 8545 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 28): 28 CREATE_TABLE default.table_154fc524efb24453bdb6d735e4c741e9
*** Check failure stack trace: ***
@ 0x7ffa62bb69ad google::LogMessage::Fail() at ??:0
@ 0x7ffa62bb988a google::LogMessage::SendToLog() at ??:0
I20260620 14:47:56.617348 9621 mvcc.cc:205] Tried to move back new op lower bound from 7298936317373022208 to 7298936317084385280. Current Snapshot: MvccSnapshot[applied={T|T < 7298936317373022208 or (T in {7298936317373022208})}]
I20260620 14:47:56.617605 9574 sys_catalog.cc:455] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61512e6d316d4d3a998e52511a0bba7a. Latest consensus state: current_term: 4 leader_uuid: "61512e6d316d4d3a998e52511a0bba7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:56.617926 9574 sys_catalog.cc:458] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7ffa62bb64de google::LogMessage::Flush() at ??:0
I20260620 14:47:56.617821 9624 sys_catalog.cc:455] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "61512e6d316d4d3a998e52511a0bba7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:56.618225 9624 sys_catalog.cc:458] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7ffa62bb66d1 google::LogMessage::~LogMessage() at ??:0
I20260620 14:47:56.621992 9624 sys_catalog.cc:455] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "61512e6d316d4d3a998e52511a0bba7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:56.622282 9624 sys_catalog.cc:458] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:47:56.626755 8465 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: Sending DeleteTablet for 3 replicas of tablet 77320ec0783e43c2817b0ff16134915e
@ 0x7ffa78754ba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260620 14:47:56.628870 8465 catalog_manager.cc:6565] ReplaceTablet: tablet 77320ec0783e43c2817b0ff16134915e deleted and replaced by tablet 17c70368ee9e4328bd780654572e1905
I20260620 14:47:56.629381 8465 master_service.cc:946] ReplaceTablet: received request to replace tablet 3a85749745a7440fb637d4918de5f798 from {username='slave'} at 127.0.0.1:45198
I20260620 14:47:56.635846 8468 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: Sending DeleteTablet for 3 replicas of tablet 1c65081e59334f90839952e5d1eda960
I20260620 14:47:56.636353 8468 catalog_manager.cc:6565] ReplaceTablet: tablet 1c65081e59334f90839952e5d1eda960 deleted and replaced by tablet a8aa5397f7914b83a1d94bd14455f98d
I20260620 14:47:56.636161 9611 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "61512e6d316d4d3a998e52511a0bba7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:56.636495 9611 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: This master's current role is: LEADER
I20260620 14:47:56.636590 8468 master_service.cc:946] ReplaceTablet: received request to replace tablet a4552c4e15464f21a10b6c2d83f7ead8 from {username='slave'} at 127.0.0.1:45198
I20260620 14:47:56.638988 8465 master_service.cc:946] ReplaceTablet: received request to replace tablet 493a30104eab4762a3f4ffae3491765e from {username='slave'} at 127.0.0.1:45198
@ 0x7ffa78753901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260620 14:47:56.645068 8914 tablet_service.cc:1514] Processing DeleteTablet for tablet 77320ec0783e43c2817b0ff16134915e with delete_type TABLET_DATA_DELETED (replaced by tablet 17c70368ee9e4328bd780654572e1905) from {username='slave'} at 127.0.0.1:56460
I20260620 14:47:56.645442 8913 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c65081e59334f90839952e5d1eda960 with delete_type TABLET_DATA_DELETED (replaced by tablet a8aa5397f7914b83a1d94bd14455f98d) from {username='slave'} at 127.0.0.1:56460
@ 0x7ffa7875a66c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260620 14:47:56.659010 8468 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: Sending DeleteTablet for 3 replicas of tablet a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:47:56.659538 8468 catalog_manager.cc:6565] ReplaceTablet: tablet a4552c4e15464f21a10b6c2d83f7ead8 deleted and replaced by tablet 16ecb528da2746fda47d12a11af8b774
I20260620 14:47:56.660542 8465 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: Sending DeleteTablet for 3 replicas of tablet 493a30104eab4762a3f4ffae3491765e
I20260620 14:47:56.661221 8465 catalog_manager.cc:6565] ReplaceTablet: tablet 493a30104eab4762a3f4ffae3491765e deleted and replaced by tablet 76cc8408ccc842ecac157fbc92540f2d
I20260620 14:47:56.662567 8912 tablet_service.cc:1514] Processing DeleteTablet for tablet 493a30104eab4762a3f4ffae3491765e with delete_type TABLET_DATA_DELETED (replaced by tablet 76cc8408ccc842ecac157fbc92540f2d) from {username='slave'} at 127.0.0.1:56460
I20260620 14:47:56.663452 8913 tablet_service.cc:1514] Processing DeleteTablet for tablet a4552c4e15464f21a10b6c2d83f7ead8 with delete_type TABLET_DATA_DELETED (replaced by tablet 16ecb528da2746fda47d12a11af8b774) from {username='slave'} at 127.0.0.1:56460
@ 0x7ffa7875a4e9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
I20260620 14:47:56.667815 8776 tablet_service.cc:1514] Processing DeleteTablet for tablet 77320ec0783e43c2817b0ff16134915e with delete_type TABLET_DATA_DELETED (replaced by tablet 17c70368ee9e4328bd780654572e1905) from {username='slave'} at 127.0.0.1:49720
I20260620 14:47:56.668285 8780 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c65081e59334f90839952e5d1eda960 with delete_type TABLET_DATA_DELETED (replaced by tablet a8aa5397f7914b83a1d94bd14455f98d) from {username='slave'} at 127.0.0.1:49720
I20260620 14:47:56.668536 8777 tablet_service.cc:1514] Processing DeleteTablet for tablet a4552c4e15464f21a10b6c2d83f7ead8 with delete_type TABLET_DATA_DELETED (replaced by tablet 16ecb528da2746fda47d12a11af8b774) from {username='slave'} at 127.0.0.1:49720
I20260620 14:47:56.668802 8779 tablet_service.cc:1514] Processing DeleteTablet for tablet 493a30104eab4762a3f4ffae3491765e with delete_type TABLET_DATA_DELETED (replaced by tablet 76cc8408ccc842ecac157fbc92540f2d) from {username='slave'} at 127.0.0.1:49720
@ 0x7ffa657e0eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7ffa68aba6db start_thread at ??:0
@ 0x7ffa61a5061f clone at ??:0
I20260620 14:47:56.675348 9641 tablet_replica.cc:330] T 77320ec0783e43c2817b0ff16134915e P 36236dd5bd604ba2819038e525a3790c: stopping tablet replica
I20260620 14:47:56.677019 9641 raft_consensus.cc:2229] T 77320ec0783e43c2817b0ff16134915e P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:56.677336 9641 raft_consensus.cc:2258] T 77320ec0783e43c2817b0ff16134915e P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:56.678136 9641 ts_tablet_manager.cc:1905] T 77320ec0783e43c2817b0ff16134915e P 36236dd5bd604ba2819038e525a3790c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:56.683401 9634 tablet_replica.cc:330] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4: stopping tablet replica
I20260620 14:47:56.683625 9634 raft_consensus.cc:2229] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:47:56.683979 9634 raft_consensus.cc:2258] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:56.684691 9634 ts_tablet_manager.cc:1905] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:56.746506 9634 ts_tablet_manager.cc:1918] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:56.746695 9634 log.cc:1196] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal/wals/77320ec0783e43c2817b0ff16134915e
I20260620 14:47:56.746731 9641 ts_tablet_manager.cc:1918] T 77320ec0783e43c2817b0ff16134915e P 36236dd5bd604ba2819038e525a3790c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:56.746868 9641 log.cc:1196] T 77320ec0783e43c2817b0ff16134915e P 36236dd5bd604ba2819038e525a3790c: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal/wals/77320ec0783e43c2817b0ff16134915e
I20260620 14:47:56.747296 9641 ts_tablet_manager.cc:1939] T 77320ec0783e43c2817b0ff16134915e P 36236dd5bd604ba2819038e525a3790c: Deleting consensus metadata
I20260620 14:47:56.747931 9634 ts_tablet_manager.cc:1939] T 77320ec0783e43c2817b0ff16134915e P 6c99207e35f8463292d71c371c9546b4: Deleting consensus metadata
I20260620 14:47:56.790565 9634 tablet_replica.cc:330] T 1c65081e59334f90839952e5d1eda960 P 6c99207e35f8463292d71c371c9546b4: stopping tablet replica
I20260620 14:47:56.790562 9641 tablet_replica.cc:330] T 1c65081e59334f90839952e5d1eda960 P 36236dd5bd604ba2819038e525a3790c: stopping tablet replica
I20260620 14:47:56.790820 9641 raft_consensus.cc:2229] T 1c65081e59334f90839952e5d1eda960 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:56.790820 9634 raft_consensus.cc:2229] T 1c65081e59334f90839952e5d1eda960 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:56.791008 9641 raft_consensus.cc:2258] T 1c65081e59334f90839952e5d1eda960 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:56.791007 9634 raft_consensus.cc:2258] T 1c65081e59334f90839952e5d1eda960 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:56.791782 9634 ts_tablet_manager.cc:1905] T 1c65081e59334f90839952e5d1eda960 P 6c99207e35f8463292d71c371c9546b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:56.792536 9641 ts_tablet_manager.cc:1905] T 1c65081e59334f90839952e5d1eda960 P 36236dd5bd604ba2819038e525a3790c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:56.848821 9634 ts_tablet_manager.cc:1918] T 1c65081e59334f90839952e5d1eda960 P 6c99207e35f8463292d71c371c9546b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:56.849051 9634 log.cc:1196] T 1c65081e59334f90839952e5d1eda960 P 6c99207e35f8463292d71c371c9546b4: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal/wals/1c65081e59334f90839952e5d1eda960
I20260620 14:47:56.849085 9641 ts_tablet_manager.cc:1918] T 1c65081e59334f90839952e5d1eda960 P 36236dd5bd604ba2819038e525a3790c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:56.849334 9641 log.cc:1196] T 1c65081e59334f90839952e5d1eda960 P 36236dd5bd604ba2819038e525a3790c: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal/wals/1c65081e59334f90839952e5d1eda960
I20260620 14:47:56.849498 9634 ts_tablet_manager.cc:1939] T 1c65081e59334f90839952e5d1eda960 P 6c99207e35f8463292d71c371c9546b4: Deleting consensus metadata
I20260620 14:47:56.849807 9641 ts_tablet_manager.cc:1939] T 1c65081e59334f90839952e5d1eda960 P 36236dd5bd604ba2819038e525a3790c: Deleting consensus metadata
W20260620 14:47:56.877090 8733 connection.cc:535] server connection from 127.0.0.1:49720 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 14:47:56.877151 8869 connection.cc:535] server connection from 127.0.0.1:56460 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 14:47:56.877694 9629 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:47:56.628986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52296 (local address 127.7.222.193:33821)
0620 14:47:56.636888 (+ 7902us) server_negotiation.cc:206] Beginning negotiation
0620 14:47:56.636893 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 14:47:56.636910 (+ 17us) server_negotiation.cc:407] Connection header received
0620 14:47:56.636971 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:47:56.636975 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:47:56.637846 (+ 871us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:47:56.637944 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:47:56.659587 (+ 21643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:47:56.660647 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:47:56.680259 (+ 19612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0620 14:47:56.682108 (+ 1849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0620 14:47:56.682271 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0620 14:47:56.682423 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0620 14:47:56.877360 (+194937us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52296: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":7786,"spinlock_wait_cycles":5888,"thread_start_us":7761,"threads_started":1}
W20260620 14:47:56.877735 8990 connection.cc:535] client connection to 127.7.222.252:36651 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 14:47:56.878515 8990 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.7.222.252:36651)
W20260620 14:47:56.878980 8990 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.7.222.252:36651)
W20260620 14:47:56.879927 8990 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.7.222.252:36651)
W20260620 14:47:56.880298 8990 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.7.222.252:36651)
I20260620 14:47:56.907536 9634 tablet_replica.cc:330] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4: stopping tablet replica
W20260620 14:47:56.907586 8869 connection.cc:441] server connection from 127.0.0.1:56460 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56460 (request call id 1) could send its response
I20260620 14:47:56.907837 9634 raft_consensus.cc:2229] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:47:56.908156 9634 raft_consensus.cc:2258] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:56.908656 9634 ts_tablet_manager.cc:1905] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:56.921666 9641 tablet_replica.cc:330] T a4552c4e15464f21a10b6c2d83f7ead8 P 36236dd5bd604ba2819038e525a3790c: stopping tablet replica
W20260620 14:47:56.921605 8733 connection.cc:441] server connection from 127.0.0.1:49720 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49720 (request call id 1) could send its response
I20260620 14:47:56.922079 9641 raft_consensus.cc:2229] T a4552c4e15464f21a10b6c2d83f7ead8 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:56.922346 9641 raft_consensus.cc:2258] T a4552c4e15464f21a10b6c2d83f7ead8 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:56.923439 9641 ts_tablet_manager.cc:1905] T a4552c4e15464f21a10b6c2d83f7ead8 P 36236dd5bd604ba2819038e525a3790c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:56.948220 9641 ts_tablet_manager.cc:1918] T a4552c4e15464f21a10b6c2d83f7ead8 P 36236dd5bd604ba2819038e525a3790c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:47:56.948405 9641 log.cc:1196] T a4552c4e15464f21a10b6c2d83f7ead8 P 36236dd5bd604ba2819038e525a3790c: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal/wals/a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:47:56.949422 9641 ts_tablet_manager.cc:1939] T a4552c4e15464f21a10b6c2d83f7ead8 P 36236dd5bd604ba2819038e525a3790c: Deleting consensus metadata
I20260620 14:47:56.949605 9634 ts_tablet_manager.cc:1918] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:56.949802 9634 log.cc:1196] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal/wals/493a30104eab4762a3f4ffae3491765e
I20260620 14:47:56.950295 9634 ts_tablet_manager.cc:1939] T 493a30104eab4762a3f4ffae3491765e P 6c99207e35f8463292d71c371c9546b4: Deleting consensus metadata
W20260620 14:47:56.988893 8733 connection.cc:441] server connection from 127.0.0.1:49720 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49720 (request call id 2) could send its response
I20260620 14:47:56.989328 9641 tablet_replica.cc:330] T 493a30104eab4762a3f4ffae3491765e P 36236dd5bd604ba2819038e525a3790c: stopping tablet replica
W20260620 14:47:56.989545 8871 consensus_peers.cc:487] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260620 14:47:56.989581 9641 raft_consensus.cc:2229] T 493a30104eab4762a3f4ffae3491765e P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:47:56.989766 9641 raft_consensus.cc:2258] T 493a30104eab4762a3f4ffae3491765e P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:56.990864 9641 ts_tablet_manager.cc:1905] T 493a30104eab4762a3f4ffae3491765e P 36236dd5bd604ba2819038e525a3790c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:57.023018 9634 tablet_replica.cc:330] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4: stopping tablet replica
W20260620 14:47:57.022950 8869 connection.cc:441] server connection from 127.0.0.1:56460 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56460 (request call id 3) could send its response
I20260620 14:47:57.023278 9634 raft_consensus.cc:2229] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:47:57.023535 9634 raft_consensus.cc:2258] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:47:57.024013 9634 ts_tablet_manager.cc:1905] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:47:57.052887 9634 ts_tablet_manager.cc:1918] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:47:57.053124 9634 log.cc:1196] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal/wals/a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:47:57.053216 9641 ts_tablet_manager.cc:1918] T 493a30104eab4762a3f4ffae3491765e P 36236dd5bd604ba2819038e525a3790c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:47:57.053433 9641 log.cc:1196] T 493a30104eab4762a3f4ffae3491765e P 36236dd5bd604ba2819038e525a3790c: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal/wals/493a30104eab4762a3f4ffae3491765e
I20260620 14:47:57.053568 9634 ts_tablet_manager.cc:1939] T a4552c4e15464f21a10b6c2d83f7ead8 P 6c99207e35f8463292d71c371c9546b4: Deleting consensus metadata
I20260620 14:47:57.053875 9641 ts_tablet_manager.cc:1939] T 493a30104eab4762a3f4ffae3491765e P 36236dd5bd604ba2819038e525a3790c: Deleting consensus metadata
W20260620 14:47:57.122923 8733 connection.cc:441] server connection from 127.0.0.1:49720 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49720 (request call id 3) could send its response
W20260620 14:47:57.123051 8869 connection.cc:441] server connection from 127.0.0.1:56460 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56460 (request call id 2) could send its response
I20260620 14:47:57.149925 9653 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61512e6d316d4d3a998e52511a0bba7a)
I20260620 14:47:57.150190 9653 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:57.151017 9653 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:47:57.153013 9517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
W20260620 14:47:57.153180 9514 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:47:57.153290 9514 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:47:57.153563 9653 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 14:47:57.726207 9660 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 61512e6d316d4d3a998e52511a0bba7a)
I20260620 14:47:57.726424 9660 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:57.727190 9660 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:47:57.730074 9514 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:47:57.732846 9517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:47:57.733053 9517 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:47:57.733331 9660 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260620 14:47:57.744499 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 1: this message will repeat every 5th retry.
W20260620 14:47:57.838138 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 1: this message will repeat every 5th retry.
I20260620 14:47:57.884646 8059 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task9VKlbC/build/asan/bin/kudu pid 9494
I20260620 14:47:57.892844 9560 generic_service.cc:196] Checking for leaks (request via RPC)
I20260620 14:47:58.019544 8059 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9VKlbC/build/asan/bin/kudu with pid 9494
I20260620 14:47:58.617093 8059 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9VKlbC/build/asan/bin/kudu
/tmp/dist-test-task9VKlbC/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.222.253:34209
--webserver_interface=127.7.222.253
--webserver_port=40901
--builtin_ntp_servers=127.7.222.212:42755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--hive_metastore_uris=thrift://127.0.0.1:42797
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260620 14:47:58.960652 9673 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:47:58.961090 9673 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:47:58.961238 9673 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:47:58.969211 9673 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:47:58.969349 9673 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:47:58.969452 9673 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:47:58.969542 9673 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:47:58.979241 9673 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.222.212:42755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:42797
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.222.253:34209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.222.253
--webserver_port=40901
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 13:41:20 UTC on ccycloud.quasar-vdagoi.root.comops.site
build id 4457462
ASAN enabled
I20260620 14:47:58.980685 9673 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:47:58.982702 9673 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:47:58.994410 9686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:47:58.994414 9687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:47:58.994958 9689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:47:58.995472 9673 server_base.cc:1034] running on GCE node
I20260620 14:47:58.996353 9673 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:47:58.998179 9673 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:47:58.999467 9673 hybrid_clock.cc:648] HybridClock initialized: now 1781966878999383 us; error 46 us; skew 500 ppm
I20260620 14:47:58.999831 9673 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 14:47:59.006117 9673 webserver.cc:460] Webserver started at http://127.7.222.253:40901/ using document root <none> and password file <none>
I20260620 14:47:59.006856 9673 fs_manager.cc:359] Metadata directory not provided
I20260620 14:47:59.007002 9673 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:47:59.012178 9673 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260620 14:47:59.015257 9695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:47:59.016739 9673 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260620 14:47:59.016978 9673 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data,/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
uuid: "caa9dcf251944f7d97f4ed7f3d83af44"
format_stamp: "Formatted at 2026-06-20 14:47:46 on dist-test-slave-c599"
I20260620 14:47:59.017952 9673 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:47:59.026404 9677 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:47:59.026594 9677 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:47:59.027305 9677 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:47:59.028198 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:47:59.028388 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:47:59.028566 8598 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:47:59.028828 9677 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:47:59.038852 9673 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:47:59.039744 9673 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:47:59.040088 9673 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:47:59.059194 9673 rpc_server.cc:307] RPC server started. Bound to: 127.7.222.253:34209
I20260620 14:47:59.059171 9746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.222.253:34209 every 8 connection(s)
I20260620 14:47:59.061002 9673 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data/info.pb
I20260620 14:47:59.065954 8059 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9VKlbC/build/asan/bin/kudu as pid 9673
I20260620 14:47:59.072220 9747 sys_catalog.cc:263] Verifying existing consensus state
I20260620 14:47:59.079402 9747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Bootstrap starting.
I20260620 14:47:59.098687 9747 log.cc:824] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Log is configured to *not* fsync() on all Append() calls
I20260620 14:47:59.171142 9747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Bootstrap replayed 1/1 log segments. Stats: ops{read=99 overwritten=0 applied=99 ignored=0} inserts{seen=70 ignored=0} mutations{seen=83 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 14:47:59.171820 9747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Bootstrap complete.
I20260620 14:47:59.173484 8847 heartbeater.cc:347] Connected to a master server at 127.7.222.253:34209
I20260620 14:47:59.180492 9747 raft_consensus.cc:348] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:59.181622 9747 raft_consensus.cc:729] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa9dcf251944f7d97f4ed7f3d83af44, State: Initialized, Role: FOLLOWER
I20260620 14:47:59.182327 9747 consensus_queue.cc:260] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 99, Last appended: 4.99, Last appended by leader: 99, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:59.183197 9753 sys_catalog.cc:455] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:47:59.183550 9753 sys_catalog.cc:458] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:47:59.184239 9747 sys_catalog.cc:564] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:47:59.198137 9767 catalog_manager.cc:1259] Loaded cluster ID: 700994c053c643c896af12c77a108604
I20260620 14:47:59.198266 9767 catalog_manager.cc:1552] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: loading cluster ID for follower catalog manager: success
I20260620 14:47:59.203302 9767 catalog_manager.cc:1574] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: acquiring CA information for follower catalog manager: success
I20260620 14:47:59.208180 9767 catalog_manager.cc:1602] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 14:47:59.207530 9673 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:47:59.218030 9673 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:47:59.250873 9677 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:47:59.251114 9677 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:59.251914 9677 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:47:59.252892 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:47:59.253091 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:47:59.253237 8596 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:47:59.253512 9677 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:47:59.255059 9677 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:47:59.255218 9677 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:47:59.255833 9677 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:47:59.256855 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:47:59.257166 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:47:59.257287 8596 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:47:59.257529 9677 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:47:59.433254 8982 heartbeater.cc:347] Connected to a master server at 127.7.222.253:34209
I20260620 14:47:59.436470 9712 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6c99207e35f8463292d71c371c9546b4" instance_seqno: 1781966868961030) as {username='slave'} at 127.7.222.195:47827; Asking this server to re-register.
I20260620 14:47:59.437361 8982 heartbeater.cc:464] Registering TS with master...
I20260620 14:47:59.438354 8709 heartbeater.cc:347] Connected to a master server at 127.7.222.253:34209
I20260620 14:47:59.440313 9712 ts_manager.cc:194] Registered new tserver with Master: 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:47:59.440387 9711 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" instance_seqno: 1781966867942712) as {username='slave'} at 127.7.222.193:58495; Asking this server to re-register.
I20260620 14:47:59.441093 8709 heartbeater.cc:464] Registering TS with master...
I20260620 14:47:59.442610 9711 ts_manager.cc:194] Registered new tserver with Master: c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:47:59.615456 9753 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:47:59.615744 9753 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:47:59.617580 9753 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:47:59.618227 9696 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:47:59.619731 9696 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:47:59.619957 9699 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:47:59.620131 9699 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:47:59.620435 9753 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 14:47:59.678359 9711 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "36236dd5bd604ba2819038e525a3790c" instance_seqno: 1781966868431821) as {username='slave'} at 127.7.222.194:57895; Asking this server to re-register.
I20260620 14:47:59.679111 8847 heartbeater.cc:464] Registering TS with master...
I20260620 14:47:59.680611 9711 ts_manager.cc:194] Registered new tserver with Master: 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:48:00.322830 9780 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:00.323002 9780 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:00.323695 9780 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:48:00.325815 9699 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
W20260620 14:48:00.326005 9696 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:48:00.326162 9696 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:48:00.326468 9780 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 14:48:01.333479 9794 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:01.333835 9794 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:01.334862 9794 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:48:01.338137 9699 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
W20260620 14:48:01.338402 9696 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:48:01.338542 9696 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:48:01.339018 9794 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260620 14:48:01.875512 8059 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9VKlbC/build/asan/bin/kudu
/tmp/dist-test-task9VKlbC/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.222.254:39515
--webserver_interface=127.7.222.254
--webserver_port=44159
--builtin_ntp_servers=127.7.222.212:42755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--hive_metastore_uris=thrift://127.0.0.1:42797
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260620 14:48:02.212347 9804 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:48:02.212656 9804 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:48:02.212822 9804 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:48:02.225323 9804 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:48:02.225474 9804 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:48:02.225714 9804 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:48:02.225798 9804 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:48:02.240384 9804 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.222.212:42755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:42797
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.222.254:39515
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.222.254
--webserver_port=44159
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 13:41:20 UTC on ccycloud.quasar-vdagoi.root.comops.site
build id 4457462
ASAN enabled
I20260620 14:48:02.242242 9804 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:48:02.244895 9804 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:48:02.264930 9813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:48:02.264957 9816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:48:02.265798 9818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:48:02.266388 9804 server_base.cc:1034] running on GCE node
I20260620 14:48:02.267305 9804 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:48:02.268887 9804 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:48:02.270129 9804 hybrid_clock.cc:648] HybridClock initialized: now 1781966882270050 us; error 65 us; skew 500 ppm
I20260620 14:48:02.270534 9804 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 14:48:02.273123 9804 webserver.cc:460] Webserver started at http://127.7.222.254:44159/ using document root <none> and password file <none>
I20260620 14:48:02.273830 9804 fs_manager.cc:359] Metadata directory not provided
I20260620 14:48:02.273989 9804 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:48:02.279265 9804 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260620 14:48:02.282303 9824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:48:02.283761 9804 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260620 14:48:02.283977 9804 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/data,/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/wal
uuid: "dd308569015348a7a19ba4a560de6d52"
format_stamp: "Formatted at 2026-06-20 14:47:45 on dist-test-slave-c599"
I20260620 14:48:02.285094 9804 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:48:02.304847 9804 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:48:02.305764 9804 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:48:02.306067 9804 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:48:02.327826 9804 rpc_server.cc:307] RPC server started. Bound to: 127.7.222.254:39515
I20260620 14:48:02.327857 9875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.222.254:39515 every 8 connection(s)
I20260620 14:48:02.329398 9804 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-0/data/info.pb
I20260620 14:48:02.334671 8059 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9VKlbC/build/asan/bin/kudu as pid 9804
I20260620 14:48:02.336526 9876 sys_catalog.cc:263] Verifying existing consensus state
I20260620 14:48:02.341058 9876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52: Bootstrap starting.
I20260620 14:48:02.359871 9876 log.cc:824] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52: Log is configured to *not* fsync() on all Append() calls
I20260620 14:48:02.375362 9802 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:48:02.375597 9802 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:48:02.376277 9802 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:48:02.377173 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:48:02.377384 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:48:02.377568 8596 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:48:02.377842 9802 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:48:02.436842 9876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52: Bootstrap replayed 1/1 log segments. Stats: ops{read=94 overwritten=0 applied=94 ignored=0} inserts{seen=66 ignored=0} mutations{seen=79 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 14:48:02.437390 9876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52: Bootstrap complete.
I20260620 14:48:02.441181 8981 heartbeater.cc:347] Connected to a master server at 127.7.222.254:39515
I20260620 14:48:02.446228 9876 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:02.447083 9876 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd308569015348a7a19ba4a560de6d52, State: Initialized, Role: FOLLOWER
I20260620 14:48:02.447691 9876 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 94, Last appended: 3.94, Last appended by leader: 94, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:02.448489 9882 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:48:02.448890 9882 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:48:02.449553 9876 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:48:02.469044 9896 catalog_manager.cc:1259] Loaded cluster ID: 700994c053c643c896af12c77a108604
I20260620 14:48:02.469157 9896 catalog_manager.cc:1552] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52: loading cluster ID for follower catalog manager: success
I20260620 14:48:02.478005 9896 catalog_manager.cc:1574] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52: acquiring CA information for follower catalog manager: success
I20260620 14:48:02.481655 9896 catalog_manager.cc:1602] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 14:48:02.498764 9804 master_runner.cc:186] Error getting master registration for 127.7.222.252:36651: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111),
I20260620 14:48:02.508268 9804 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:48:02.664201 9901 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:02.664472 9901 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:02.665306 9901 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:48:02.668578 9699 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:48:02.673753 9851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" candidate_term: 5 candidate_status { last_received { term: 4 index: 99 } } ignore_live_leader: false dest_uuid: "dd308569015348a7a19ba4a560de6d52" is_pre_election: true
I20260620 14:48:02.674365 9851 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate caa9dcf251944f7d97f4ed7f3d83af44 in term 3.
I20260620 14:48:02.675166 9696 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44, dd308569015348a7a19ba4a560de6d52; no voters: 61512e6d316d4d3a998e52511a0bba7a
I20260620 14:48:02.675508 9901 raft_consensus.cc:2781] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260620 14:48:02.675642 9901 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:48:02.675770 9901 raft_consensus.cc:3037] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 4 FOLLOWER]: Advancing to term 5
I20260620 14:48:02.682680 9901 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:02.684638 9851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" candidate_term: 5 candidate_status { last_received { term: 4 index: 99 } } ignore_live_leader: false dest_uuid: "dd308569015348a7a19ba4a560de6d52"
I20260620 14:48:02.685012 9851 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 3 FOLLOWER]: Advancing to term 5
W20260620 14:48:02.696787 9699 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:48:02.697105 9901 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 5 election: Requested vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
I20260620 14:48:02.698405 9851 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate caa9dcf251944f7d97f4ed7f3d83af44 in term 5.
I20260620 14:48:02.702517 9696 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44, dd308569015348a7a19ba4a560de6d52; no voters: 61512e6d316d4d3a998e52511a0bba7a
I20260620 14:48:02.703028 9901 raft_consensus.cc:2781] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 14:48:02.703953 9901 raft_consensus.cc:686] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 5 LEADER]: Becoming Leader. State: Replica: caa9dcf251944f7d97f4ed7f3d83af44, State: Running, Role: LEADER
I20260620 14:48:02.704473 9901 consensus_queue.cc:237] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 99, Committed index: 99, Last appended: 4.99, Last appended by leader: 99, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:02.707937 9910 sys_catalog.cc:455] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: SysCatalogTable state changed. Reason: New leader caa9dcf251944f7d97f4ed7f3d83af44. Latest consensus state: current_term: 5 leader_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:48:02.708344 9910 sys_catalog.cc:458] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: This master's current role is: LEADER
I20260620 14:48:02.717063 8846 heartbeater.cc:347] Connected to a master server at 127.7.222.254:39515
I20260620 14:48:02.718981 9912 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:48:02.721117 9841 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "36236dd5bd604ba2819038e525a3790c" instance_seqno: 1781966868431821) as {username='slave'} at 127.7.222.194:41233; Asking this server to re-register.
I20260620 14:48:02.722450 8846 heartbeater.cc:464] Registering TS with master...
I20260620 14:48:02.723831 9912 catalog_manager.cc:669] Loaded metadata for table default.table_4ab72ecdb6d540508f6f4b250020b540 [id=0c4867ea1c1e45f388ccd4e2c9de093e]
I20260620 14:48:02.724421 9912 catalog_manager.cc:669] Loaded metadata for table default.table_8cc72697ee4f4200a5f57a19280315ee [id=1db81c7e90894c5fac0e8fe34d1d4441]
I20260620 14:48:02.724821 9912 catalog_manager.cc:669] Loaded metadata for table default.table_105950e097bf4cbda12e7532557966b2 [id=34076de884f942fcb696a9c9524941e7]
I20260620 14:48:02.724834 9841 ts_manager.cc:194] Registered new tserver with Master: 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:48:02.725234 9912 catalog_manager.cc:669] Loaded metadata for table default.table_0eb776233cee4294b6c96ec556447663 [id=3420fc1c9c8b45f49aeaa7b4c97da51e]
I20260620 14:48:02.725631 9912 catalog_manager.cc:669] Loaded metadata for table default.table_154fc524efb24453bdb6d735e4c741e9 [id=3b08ae3b47fd46cab8ef5a41bb0bc5d7]
I20260620 14:48:02.726030 9912 catalog_manager.cc:669] Loaded metadata for table default.table_bb493f9370e74bafae7b1e42f5c5f770 [id=6a722b39b30e45649b7b70c32c9e2260]
I20260620 14:48:02.726358 9912 catalog_manager.cc:669] Loaded metadata for table default.table_7911231c2bcb420ebe8f3e12604c29e4 [id=76fec3007aa94f71867761f887e9b73e]
I20260620 14:48:02.726609 8708 heartbeater.cc:347] Connected to a master server at 127.7.222.254:39515
I20260620 14:48:02.726768 9912 catalog_manager.cc:669] Loaded metadata for table default.table_16339630485f49f6a8bb2b71981cdeb1 [id=7d2156b55c1349b2841c1d2676f74993]
I20260620 14:48:02.727157 9912 catalog_manager.cc:669] Loaded metadata for table default.table_563392802bec4e688c0eabd46ab1fd5c [id=7e71694fb4a948f09c01863575227fda]
I20260620 14:48:02.727550 9912 catalog_manager.cc:669] Loaded metadata for table default.table_fdbead99862d49af98df44683e830bf5 [id=85b633c4801d49bd9ad9b944b178e683]
I20260620 14:48:02.727783 9912 catalog_manager.cc:669] Loaded metadata for table default.table_98318448fcf3484cb76812dad2975098 [id=862dd3cee25c40eead9feb394a8b58b1]
I20260620 14:48:02.728128 9912 catalog_manager.cc:669] Loaded metadata for table default.table_19c624001d444b7b9939e22128c594aa [id=98d2e7b647544a97b50827a0cb2799a0]
I20260620 14:48:02.728574 9912 catalog_manager.cc:669] Loaded metadata for table default.table_e8372b71bacb4865b4360a50af59d323 [id=9c1e21a6c9244efba2e86bfa28264a0d]
I20260620 14:48:02.729156 9912 catalog_manager.cc:669] Loaded metadata for table default.table_1ea7c21a49a443c29bd5578c5950c27f [id=bfa17da52a874fa1b587ad18d04cd740]
I20260620 14:48:02.729202 9841 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" instance_seqno: 1781966867942712) as {username='slave'} at 127.7.222.193:49741; Asking this server to re-register.
I20260620 14:48:02.729578 9912 catalog_manager.cc:669] Loaded metadata for table default.table_fe5ad6a8d59b4751bcbb6e1d0d4baedb [id=c514aca79062490a8b6a18021b07b2ff]
I20260620 14:48:02.729915 9912 catalog_manager.cc:669] Loaded metadata for table default.table_a901d915c377429a9e43cfcaf071e7d3 [id=c65e926af55d4fbba6c42f4d2ddbb397]
I20260620 14:48:02.729918 8708 heartbeater.cc:464] Registering TS with master...
I20260620 14:48:02.730163 9912 catalog_manager.cc:669] Loaded metadata for table default.table_d2959bb621be429eb5af827263887798 [id=ddb41391569b4a11b4ad85335ca24ddb]
I20260620 14:48:02.731745 9841 ts_manager.cc:194] Registered new tserver with Master: c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:48:02.732859 9912 tablet_loader.cc:96] loaded metadata for tablet 16ecb528da2746fda47d12a11af8b774 (table default.table_e8372b71bacb4865b4360a50af59d323 [id=9c1e21a6c9244efba2e86bfa28264a0d])
I20260620 14:48:02.733160 9912 tablet_loader.cc:96] loaded metadata for tablet 17c70368ee9e4328bd780654572e1905 (table default.table_154fc524efb24453bdb6d735e4c741e9 [id=3b08ae3b47fd46cab8ef5a41bb0bc5d7])
I20260620 14:48:02.733516 9912 tablet_loader.cc:96] loaded metadata for tablet 1ad679f398ab41a1bc207b016648cbe8 (table default.table_19c624001d444b7b9939e22128c594aa [id=98d2e7b647544a97b50827a0cb2799a0])
I20260620 14:48:02.734082 9912 tablet_loader.cc:96] loaded metadata for tablet 26639d34678c4f77994cd44313b98898 (table default.table_16339630485f49f6a8bb2b71981cdeb1 [id=7d2156b55c1349b2841c1d2676f74993])
I20260620 14:48:02.734390 9912 tablet_loader.cc:96] loaded metadata for tablet 2b45f60882664099b090170903fe74b2 (table default.table_0eb776233cee4294b6c96ec556447663 [id=3420fc1c9c8b45f49aeaa7b4c97da51e])
I20260620 14:48:02.734817 9912 tablet_loader.cc:96] loaded metadata for tablet 309a0915648643ada08981a11e7a1e59 (table default.table_563392802bec4e688c0eabd46ab1fd5c [id=7e71694fb4a948f09c01863575227fda])
I20260620 14:48:02.735868 9912 tablet_loader.cc:96] loaded metadata for tablet 675413dc550f485dbef0d180ed27ff0e (table default.table_4ab72ecdb6d540508f6f4b250020b540 [id=0c4867ea1c1e45f388ccd4e2c9de093e])
I20260620 14:48:02.736158 9912 tablet_loader.cc:96] loaded metadata for tablet 73a17f00358f415d8b72a53859963eac (table default.table_7911231c2bcb420ebe8f3e12604c29e4 [id=76fec3007aa94f71867761f887e9b73e])
I20260620 14:48:02.736447 9912 tablet_loader.cc:96] loaded metadata for tablet 753328bb98be4189abdbf6d60ef95fc9 (table default.table_98318448fcf3484cb76812dad2975098 [id=862dd3cee25c40eead9feb394a8b58b1])
I20260620 14:48:02.736682 9912 tablet_loader.cc:96] loaded metadata for tablet 76cc8408ccc842ecac157fbc92540f2d (table default.table_fdbead99862d49af98df44683e830bf5 [id=85b633c4801d49bd9ad9b944b178e683])
I20260620 14:48:02.737365 9912 tablet_loader.cc:96] loaded metadata for tablet 7a78d61e26c645b6bd82b6070c677b98 (table default.table_d2959bb621be429eb5af827263887798 [id=ddb41391569b4a11b4ad85335ca24ddb])
I20260620 14:48:02.737632 9912 tablet_loader.cc:96] loaded metadata for tablet 8caaa1b5e0384a6ab49b9fd7162896c8 (table default.table_bb493f9370e74bafae7b1e42f5c5f770 [id=6a722b39b30e45649b7b70c32c9e2260])
I20260620 14:48:02.737970 9912 tablet_loader.cc:96] loaded metadata for tablet 8e2d76b1afb147088869a6180d5bc03e (table default.table_105950e097bf4cbda12e7532557966b2 [id=34076de884f942fcb696a9c9524941e7])
I20260620 14:48:02.738346 9912 tablet_loader.cc:96] loaded metadata for tablet a8aa5397f7914b83a1d94bd14455f98d (table default.table_1ea7c21a49a443c29bd5578c5950c27f [id=bfa17da52a874fa1b587ad18d04cd740])
I20260620 14:48:02.738761 9912 tablet_loader.cc:96] loaded metadata for tablet bd541e6a431348c7a506611681730fc5 (table default.table_a901d915c377429a9e43cfcaf071e7d3 [id=c65e926af55d4fbba6c42f4d2ddbb397])
I20260620 14:48:02.739280 9912 tablet_loader.cc:96] loaded metadata for tablet c4e5daabb2954a6f955fd4857b362884 (table default.table_8cc72697ee4f4200a5f57a19280315ee [id=1db81c7e90894c5fac0e8fe34d1d4441])
I20260620 14:48:02.739939 9912 tablet_loader.cc:96] loaded metadata for tablet eb6d101c1a5444cabf7c966c7ac7134e (table default.table_fe5ad6a8d59b4751bcbb6e1d0d4baedb [id=c514aca79062490a8b6a18021b07b2ff])
I20260620 14:48:02.740216 9912 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:48:02.741640 9912 catalog_manager.cc:1259] Loaded cluster ID: 700994c053c643c896af12c77a108604
I20260620 14:48:02.741712 9912 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:48:02.743306 9912 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:48:02.744576 9912 catalog_manager.cc:5879] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Loaded TSK: 0
I20260620 14:48:02.745499 9912 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 14:48:02.746724 9912 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260620 14:48:02.747941 9912 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: 27
I20260620 14:48:02.811658 9711 master_service.cc:946] ReplaceTablet: received request to replace tablet 2b45f60882664099b090170903fe74b2 from {username='slave'} at 127.0.0.1:45186
I20260620 14:48:02.813319 9705 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45186:
name: "default.Table_9d59fa2b31544f17b044945d2a45a612"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:48:02.814401 9712 master_service.cc:946] ReplaceTablet: received request to replace tablet c4e5daabb2954a6f955fd4857b362884 from {username='slave'} at 127.0.0.1:45186
I20260620 14:48:02.815742 9710 master_service.cc:946] ReplaceTablet: received request to replace tablet 493a30104eab4762a3f4ffae3491765e from {username='slave'} at 127.0.0.1:45186
I20260620 14:48:02.817047 9710 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45186:
table { table_name: "default.Table_bb493f9370e74bafae7b1e42f5c5f770" } modify_external_catalogs: true
I20260620 14:48:02.817451 9710 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45186:
table { table_name: "default.Table_bb493f9370e74bafae7b1e42f5c5f770" } modify_external_catalogs: true
I20260620 14:48:02.819429 9907 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:48:02.819610 9907 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:48:02.820461 9907 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:48:02.821763 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:48:02.818034 9709 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45186:
name: "default.Table_2d00c2dfdbfe428a8de80587e6f6e918"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:48:02.818850 9708 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45186:
name: "default.Table_96a3abe199c94222aea451130599b401"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:48:02.819463 9707 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45186:
name: "default.Table_63c7519d9a2a45b980b2d44a70aec200"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:48:02.820025 9706 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45186:
name: "default.Table_4f7f7c8b2fa84940bcb443efbbded490"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:48:02.820580 9704 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45186:
name: "default.Table_34a7935bc68a42c3aa8f0c43b09b30a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:48:02.821125 9703 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45186:
name: "default.Table_13f389c96bd0448091e94f5127394533"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:48:02.828073 9766 catalog_manager.cc:2709] Deleting table default.table_2d00c2dfdbfe428a8de80587e6f6e918 [id=a17882ca0acc459caae49f8238c7df14] in response to Hive Metastore notification log event 28
W20260620 14:48:02.828572 9766 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 28 DROP_TABLE default.table_2d00c2dfdbfe428a8de80587e6f6e918: Not found: the table does not exist: table_id: "a17882ca0acc459caae49f8238c7df14" table_name: "default.table_2d00c2dfdbfe428a8de80587e6f6e918"
F20260620 14:48:02.828701 9766 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 28): 28 CREATE_TABLE default.table_154fc524efb24453bdb6d735e4c741e9
I20260620 14:48:02.829145 9851 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 5 FOLLOWER]: Refusing update from remote peer caa9dcf251944f7d97f4ed7f3d83af44: Log matching property violated. Preceding OpId in replica: term: 3 index: 94. Preceding OpId from leader: term: 5 index: 102. (index mismatch)
*** Check failure stack trace: ***
I20260620 14:48:02.830191 9910 consensus_queue.cc:1035] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 100, Last known committed idx: 94, Time since last communication: 0.000s
@ 0x7f27842689ad google::LogMessage::Fail() at ??:0
@ 0x7f278426b88a google::LogMessage::SendToLog() at ??:0
W20260620 14:48:02.834076 9699 consensus_peers.cc:487] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 -> Peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Couldn't send request to peer 61512e6d316d4d3a998e52511a0bba7a. Status: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
@ 0x7f27842684de google::LogMessage::Flush() at ??:0
@ 0x7f27842686d1 google::LogMessage::~LogMessage() at ??:0
W20260620 14:48:02.839747 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:48:02.839919 8598 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:48:02.840523 9907 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
@ 0x7f2799e06ba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f2799e05901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7f2799e0c66c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7f2799e0c4e9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f2786e92eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f278a16c6db start_thread at ??:0
@ 0x7f278310261f clone at ??:0
I20260620 14:48:02.882449 9882 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader caa9dcf251944f7d97f4ed7f3d83af44. Latest consensus state: current_term: 5 leader_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:48:02.882761 9882 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:48:02.883066 9920 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:48:02.883399 9920 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:48:02.947038 9841 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6c99207e35f8463292d71c371c9546b4" instance_seqno: 1781966868961030) as {username='slave'} at 127.7.222.195:51639; Asking this server to re-register.
I20260620 14:48:02.947868 8981 heartbeater.cc:464] Registering TS with master...
I20260620 14:48:02.949429 9841 ts_manager.cc:194] Registered new tserver with Master: 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:48:03.059031 9826 connection.cc:535] server connection from 127.0.0.1:48420 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 14:48:03.059098 8597 connection.cc:535] client connection to 127.7.222.253:34209 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 14:48:03.059767 8870 connection.cc:535] client connection to 127.7.222.253:34209 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 14:48:03.059809 8989 connection.cc:535] client connection to 127.7.222.253:34209 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 14:48:03.060652 8989 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.7.222.253:34209)
W20260620 14:48:03.061647 8989 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.7.222.253:34209)
W20260620 14:48:03.061985 8989 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.7.222.253:34209)
W20260620 14:48:03.062310 8989 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.7.222.253:34209)
I20260620 14:48:03.310508 9802 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:48:03.310738 9802 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:48:03.311369 9802 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:48:03.312254 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:48:03.312462 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:48:03.312620 8598 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:48:03.312940 9802 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:48:03.336007 9920 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader caa9dcf251944f7d97f4ed7f3d83af44)
I20260620 14:48:03.336223 9920 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:03.338203 9920 leader_election.cc:288] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:48:03.339119 9827 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
W20260620 14:48:03.340965 9827 leader_election.cc:334] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209): Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
W20260620 14:48:03.341173 9828 leader_election.cc:334] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:48:03.341331 9828 leader_election.cc:302] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd308569015348a7a19ba4a560de6d52; no voters: 61512e6d316d4d3a998e52511a0bba7a, caa9dcf251944f7d97f4ed7f3d83af44
I20260620 14:48:03.341905 9920 raft_consensus.cc:2726] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 14:48:04.031492 9941 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader caa9dcf251944f7d97f4ed7f3d83af44)
I20260620 14:48:04.031744 9941 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:04.032519 9941 leader_election.cc:288] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:48:04.034842 9827 leader_election.cc:334] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209): Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
W20260620 14:48:04.035053 9828 leader_election.cc:334] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:48:04.035190 9828 leader_election.cc:302] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd308569015348a7a19ba4a560de6d52; no voters: 61512e6d316d4d3a998e52511a0bba7a, caa9dcf251944f7d97f4ed7f3d83af44
I20260620 14:48:04.035429 9941 raft_consensus.cc:2726] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 14:48:05.064033 9952 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader caa9dcf251944f7d97f4ed7f3d83af44)
I20260620 14:48:05.064260 9952 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:05.065054 9952 leader_election.cc:288] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:48:05.067101 9827 leader_election.cc:334] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209): Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
W20260620 14:48:05.067306 9828 leader_election.cc:334] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:48:05.067422 9828 leader_election.cc:302] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd308569015348a7a19ba4a560de6d52; no voters: 61512e6d316d4d3a998e52511a0bba7a, caa9dcf251944f7d97f4ed7f3d83af44
I20260620 14:48:05.067654 9952 raft_consensus.cc:2726] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 14:48:05.497088 8059 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9VKlbC/build/asan/bin/kudu
/tmp/dist-test-task9VKlbC/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.222.252:36651
--webserver_interface=127.7.222.252
--webserver_port=40883
--builtin_ntp_servers=127.7.222.212:42755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--hive_metastore_uris=thrift://127.0.0.1:42797
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260620 14:48:05.830528 9960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:48:05.830827 9960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:48:05.830904 9960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:48:05.838788 9960 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:48:05.838896 9960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:48:05.838938 9960 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:48:05.838994 9960 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:48:05.848223 9960 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.222.212:42755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:42797
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.222.252:36651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.222.252
--webserver_port=40883
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 13:41:20 UTC on ccycloud.quasar-vdagoi.root.comops.site
build id 4457462
ASAN enabled
I20260620 14:48:05.849951 9960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:48:05.851979 9960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:48:05.864493 9968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:48:05.864866 9967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:48:05.865017 9970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:48:05.865777 9960 server_base.cc:1034] running on GCE node
I20260620 14:48:05.866658 9960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:48:05.868194 9960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:48:05.869467 9960 hybrid_clock.cc:648] HybridClock initialized: now 1781966885869397 us; error 41 us; skew 500 ppm
I20260620 14:48:05.869853 9960 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 14:48:05.877167 9960 webserver.cc:460] Webserver started at http://127.7.222.252:40883/ using document root <none> and password file <none>
I20260620 14:48:05.877923 9960 fs_manager.cc:359] Metadata directory not provided
I20260620 14:48:05.878082 9960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:48:05.883860 9960 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.003s
I20260620 14:48:05.888016 9978 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:48:05.889901 9960 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260620 14:48:05.890089 9960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/data,/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/wal
uuid: "61512e6d316d4d3a998e52511a0bba7a"
format_stamp: "Formatted at 2026-06-20 14:47:46 on dist-test-slave-c599"
I20260620 14:48:05.891093 9960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:48:05.903218 9960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:48:05.904075 9960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:48:05.904388 9960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:48:05.923118 9960 rpc_server.cc:307] RPC server started. Bound to: 127.7.222.252:36651
I20260620 14:48:05.923121 10029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.222.252:36651 every 8 connection(s)
I20260620 14:48:05.924692 9960 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/data/info.pb
I20260620 14:48:05.931253 10030 sys_catalog.cc:263] Verifying existing consensus state
I20260620 14:48:05.934633 10030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: Bootstrap starting.
I20260620 14:48:05.935247 8059 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9VKlbC/build/asan/bin/kudu as pid 9960
I20260620 14:48:05.952208 8980 heartbeater.cc:347] Connected to a master server at 127.7.222.252:36651
I20260620 14:48:05.957362 10030 log.cc:824] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: Log is configured to *not* fsync() on all Append() calls
I20260620 14:48:06.031688 10030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: Bootstrap replayed 1/1 log segments. Stats: ops{read=99 overwritten=0 applied=99 ignored=0} inserts{seen=70 ignored=0} mutations{seen=83 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 14:48:06.032271 10030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: Bootstrap complete.
I20260620 14:48:06.040231 10030 raft_consensus.cc:348] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:06.041298 10030 raft_consensus.cc:729] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61512e6d316d4d3a998e52511a0bba7a, State: Initialized, Role: FOLLOWER
I20260620 14:48:06.041970 10030 consensus_queue.cc:260] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 99, Last appended: 4.99, Last appended by leader: 99, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:06.042806 10035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:48:06.043224 10035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:48:06.043807 10030 sys_catalog.cc:564] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:48:06.074597 10049 catalog_manager.cc:1259] Loaded cluster ID: 700994c053c643c896af12c77a108604
I20260620 14:48:06.074869 10049 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: loading cluster ID for follower catalog manager: success
I20260620 14:48:06.080826 10049 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: acquiring CA information for follower catalog manager: success
I20260620 14:48:06.085132 10049 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 14:48:06.090410 10054 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader caa9dcf251944f7d97f4ed7f3d83af44)
I20260620 14:48:06.090598 10054 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:06.093065 10054 leader_election.cc:288] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
I20260620 14:48:06.091823 9960 master_runner.cc:186] Error getting master registration for 127.7.222.253:34209: Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111),
I20260620 14:48:06.102488 9960 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 14:48:06.102977 9827 leader_election.cc:334] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209): Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
I20260620 14:48:06.108772 10005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dd308569015348a7a19ba4a560de6d52" candidate_term: 6 candidate_status { last_received { term: 5 index: 102 } } ignore_live_leader: false dest_uuid: "61512e6d316d4d3a998e52511a0bba7a" is_pre_election: true
I20260620 14:48:06.109486 10005 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd308569015348a7a19ba4a560de6d52 in term 4.
I20260620 14:48:06.110146 9828 leader_election.cc:302] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52; no voters: caa9dcf251944f7d97f4ed7f3d83af44
I20260620 14:48:06.110502 10054 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260620 14:48:06.110641 10054 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 5 FOLLOWER]: Starting leader election (detected failure of leader caa9dcf251944f7d97f4ed7f3d83af44)
I20260620 14:48:06.110749 10054 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 5 FOLLOWER]: Advancing to term 6
I20260620 14:48:06.112852 10054 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:06.113538 10054 leader_election.cc:288] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 6 election: Requested vote from peers caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
I20260620 14:48:06.114112 10005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dd308569015348a7a19ba4a560de6d52" candidate_term: 6 candidate_status { last_received { term: 5 index: 102 } } ignore_live_leader: false dest_uuid: "61512e6d316d4d3a998e52511a0bba7a"
I20260620 14:48:06.114336 10005 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 4 FOLLOWER]: Advancing to term 6
W20260620 14:48:06.114892 9827 leader_election.cc:334] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209): Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
I20260620 14:48:06.120726 10005 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd308569015348a7a19ba4a560de6d52 in term 6.
I20260620 14:48:06.121251 9828 leader_election.cc:302] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52; no voters: caa9dcf251944f7d97f4ed7f3d83af44
I20260620 14:48:06.121620 10054 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 6 FOLLOWER]: Leader election won for term 6
I20260620 14:48:06.122188 10054 raft_consensus.cc:686] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [term 6 LEADER]: Becoming Leader. State: Replica: dd308569015348a7a19ba4a560de6d52, State: Running, Role: LEADER
I20260620 14:48:06.122673 10054 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 99, Committed index: 99, Last appended: 5.102, Last appended by leader: 102, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:06.124311 10058 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd308569015348a7a19ba4a560de6d52. Latest consensus state: current_term: 6 leader_uuid: "dd308569015348a7a19ba4a560de6d52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:48:06.124641 10058 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: This master's current role is: LEADER
I20260620 14:48:06.202136 8845 heartbeater.cc:347] Connected to a master server at 127.7.222.252:36651
I20260620 14:48:06.205399 9995 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "36236dd5bd604ba2819038e525a3790c" instance_seqno: 1781966868431821) as {username='slave'} at 127.7.222.194:52215; Asking this server to re-register.
I20260620 14:48:06.206149 8845 heartbeater.cc:464] Registering TS with master...
I20260620 14:48:06.208057 9995 ts_manager.cc:194] Registered new tserver with Master: 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:48:06.375802 8707 heartbeater.cc:347] Connected to a master server at 127.7.222.252:36651
I20260620 14:48:06.377624 9995 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" instance_seqno: 1781966867942712) as {username='slave'} at 127.7.222.193:56711; Asking this server to re-register.
I20260620 14:48:06.378328 8707 heartbeater.cc:464] Registering TS with master...
I20260620 14:48:06.380200 9995 ts_manager.cc:194] Registered new tserver with Master: c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:48:06.442027 9977 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:48:06.442253 9977 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:48:06.443221 9977 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:48:06.444209 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:48:06.444499 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:48:06.444634 8598 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:48:06.444958 9977 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:48:06.461546 9995 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6c99207e35f8463292d71c371c9546b4" instance_seqno: 1781966868961030) as {username='slave'} at 127.7.222.195:42639; Asking this server to re-register.
I20260620 14:48:06.462285 8980 heartbeater.cc:464] Registering TS with master...
I20260620 14:48:06.463686 9995 ts_manager.cc:194] Registered new tserver with Master: 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:48:06.635021 10063 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:06.635253 10063 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:06.636996 10063 leader_election.cc:288] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209)
I20260620 14:48:06.637573 9851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "61512e6d316d4d3a998e52511a0bba7a" candidate_term: 7 candidate_status { last_received { term: 4 index: 99 } } ignore_live_leader: false dest_uuid: "dd308569015348a7a19ba4a560de6d52" is_pre_election: true
W20260620 14:48:06.637969 9981 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
W20260620 14:48:06.639325 9981 leader_election.cc:334] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209): Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
I20260620 14:48:06.639540 9981 leader_election.cc:302] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61512e6d316d4d3a998e52511a0bba7a; no voters: caa9dcf251944f7d97f4ed7f3d83af44, dd308569015348a7a19ba4a560de6d52
I20260620 14:48:06.639889 10063 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260620 14:48:06.655978 9827 consensus_peers.cc:487] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 -> Peer caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209): Couldn't send request to peer caa9dcf251944f7d97f4ed7f3d83af44. Status: Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 14:48:06.694031 10005 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Refusing update from remote peer dd308569015348a7a19ba4a560de6d52: Log matching property violated. Preceding OpId in replica: term: 4 index: 99. Preceding OpId from leader: term: 6 index: 103. (index mismatch)
I20260620 14:48:06.694849 10066 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 103, Last known committed idx: 99, Time since last communication: 0.000s
I20260620 14:48:06.700592 10063 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd308569015348a7a19ba4a560de6d52. Latest consensus state: current_term: 6 leader_uuid: "dd308569015348a7a19ba4a560de6d52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:48:06.701068 10063 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:48:06.711604 10066 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "dd308569015348a7a19ba4a560de6d52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:48:06.711881 10066 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: This master's current role is: LEADER
I20260620 14:48:06.711905 10063 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "dd308569015348a7a19ba4a560de6d52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:48:06.712203 10063 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:48:06.712451 10071 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "dd308569015348a7a19ba4a560de6d52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:48:06.712700 10071 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52 [sys.catalog]: This master's current role is: LEADER
I20260620 14:48:06.712438 10079 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "dd308569015348a7a19ba4a560de6d52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:48:06.712873 10079 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:48:06.721685 9977 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:48:06.721849 9977 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:48:06.722456 9977 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:48:06.723397 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:48:06.723606 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:48:06.723734 8596 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:48:06.724045 9977 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:48:06.770146 10060 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:48:06.773229 10060 catalog_manager.cc:669] Loaded metadata for table default.table_4ab72ecdb6d540508f6f4b250020b540 [id=0c4867ea1c1e45f388ccd4e2c9de093e]
I20260620 14:48:06.773830 10060 catalog_manager.cc:669] Loaded metadata for table default.table_8cc72697ee4f4200a5f57a19280315ee [id=1db81c7e90894c5fac0e8fe34d1d4441]
I20260620 14:48:06.774173 10060 catalog_manager.cc:669] Loaded metadata for table default.table_105950e097bf4cbda12e7532557966b2 [id=34076de884f942fcb696a9c9524941e7]
I20260620 14:48:06.774533 10060 catalog_manager.cc:669] Loaded metadata for table default.table_0eb776233cee4294b6c96ec556447663 [id=3420fc1c9c8b45f49aeaa7b4c97da51e]
I20260620 14:48:06.774932 10060 catalog_manager.cc:669] Loaded metadata for table default.table_154fc524efb24453bdb6d735e4c741e9 [id=3b08ae3b47fd46cab8ef5a41bb0bc5d7]
I20260620 14:48:06.775315 10060 catalog_manager.cc:669] Loaded metadata for table default.table_bb493f9370e74bafae7b1e42f5c5f770 [id=6a722b39b30e45649b7b70c32c9e2260]
I20260620 14:48:06.775628 10060 catalog_manager.cc:669] Loaded metadata for table default.table_7911231c2bcb420ebe8f3e12604c29e4 [id=76fec3007aa94f71867761f887e9b73e]
I20260620 14:48:06.775957 10060 catalog_manager.cc:669] Loaded metadata for table default.table_16339630485f49f6a8bb2b71981cdeb1 [id=7d2156b55c1349b2841c1d2676f74993]
I20260620 14:48:06.776278 10060 catalog_manager.cc:669] Loaded metadata for table default.table_563392802bec4e688c0eabd46ab1fd5c [id=7e71694fb4a948f09c01863575227fda]
I20260620 14:48:06.776762 10060 catalog_manager.cc:669] Loaded metadata for table default.table_fdbead99862d49af98df44683e830bf5 [id=85b633c4801d49bd9ad9b944b178e683]
I20260620 14:48:06.777081 10060 catalog_manager.cc:669] Loaded metadata for table default.table_98318448fcf3484cb76812dad2975098 [id=862dd3cee25c40eead9feb394a8b58b1]
I20260620 14:48:06.777417 10060 catalog_manager.cc:669] Loaded metadata for table default.table_19c624001d444b7b9939e22128c594aa [id=98d2e7b647544a97b50827a0cb2799a0]
I20260620 14:48:06.777725 10060 catalog_manager.cc:669] Loaded metadata for table default.table_e8372b71bacb4865b4360a50af59d323 [id=9c1e21a6c9244efba2e86bfa28264a0d]
I20260620 14:48:06.778173 10060 catalog_manager.cc:669] Loaded metadata for table default.table_1ea7c21a49a443c29bd5578c5950c27f [id=bfa17da52a874fa1b587ad18d04cd740]
I20260620 14:48:06.778510 10060 catalog_manager.cc:669] Loaded metadata for table default.table_fe5ad6a8d59b4751bcbb6e1d0d4baedb [id=c514aca79062490a8b6a18021b07b2ff]
I20260620 14:48:06.778849 10060 catalog_manager.cc:669] Loaded metadata for table default.table_a901d915c377429a9e43cfcaf071e7d3 [id=c65e926af55d4fbba6c42f4d2ddbb397]
I20260620 14:48:06.779235 10060 catalog_manager.cc:669] Loaded metadata for table default.table_d2959bb621be429eb5af827263887798 [id=ddb41391569b4a11b4ad85335ca24ddb]
I20260620 14:48:06.781390 10060 tablet_loader.cc:96] loaded metadata for tablet 16ecb528da2746fda47d12a11af8b774 (table default.table_e8372b71bacb4865b4360a50af59d323 [id=9c1e21a6c9244efba2e86bfa28264a0d])
I20260620 14:48:06.781684 10060 tablet_loader.cc:96] loaded metadata for tablet 17c70368ee9e4328bd780654572e1905 (table default.table_154fc524efb24453bdb6d735e4c741e9 [id=3b08ae3b47fd46cab8ef5a41bb0bc5d7])
I20260620 14:48:06.782048 10060 tablet_loader.cc:96] loaded metadata for tablet 1ad679f398ab41a1bc207b016648cbe8 (table default.table_19c624001d444b7b9939e22128c594aa [id=98d2e7b647544a97b50827a0cb2799a0])
I20260620 14:48:06.782531 10060 tablet_loader.cc:96] loaded metadata for tablet 1c7ec92b27c444b2bc03a1993959de26 (table default.table_8cc72697ee4f4200a5f57a19280315ee [id=1db81c7e90894c5fac0e8fe34d1d4441])
I20260620 14:48:06.782950 10060 tablet_loader.cc:96] loaded metadata for tablet 26639d34678c4f77994cd44313b98898 (table default.table_16339630485f49f6a8bb2b71981cdeb1 [id=7d2156b55c1349b2841c1d2676f74993])
I20260620 14:48:06.783484 10060 tablet_loader.cc:96] loaded metadata for tablet 309a0915648643ada08981a11e7a1e59 (table default.table_563392802bec4e688c0eabd46ab1fd5c [id=7e71694fb4a948f09c01863575227fda])
I20260620 14:48:06.783747 10060 tablet_loader.cc:96] loaded metadata for tablet 31e1bc87e526443e93e1f7d9b79659a7 (table default.table_0eb776233cee4294b6c96ec556447663 [id=3420fc1c9c8b45f49aeaa7b4c97da51e])
I20260620 14:48:06.784804 10060 tablet_loader.cc:96] loaded metadata for tablet 675413dc550f485dbef0d180ed27ff0e (table default.table_4ab72ecdb6d540508f6f4b250020b540 [id=0c4867ea1c1e45f388ccd4e2c9de093e])
I20260620 14:48:06.785127 10060 tablet_loader.cc:96] loaded metadata for tablet 73a17f00358f415d8b72a53859963eac (table default.table_7911231c2bcb420ebe8f3e12604c29e4 [id=76fec3007aa94f71867761f887e9b73e])
I20260620 14:48:06.785413 10060 tablet_loader.cc:96] loaded metadata for tablet 753328bb98be4189abdbf6d60ef95fc9 (table default.table_98318448fcf3484cb76812dad2975098 [id=862dd3cee25c40eead9feb394a8b58b1])
I20260620 14:48:06.785667 10060 tablet_loader.cc:96] loaded metadata for tablet 76cc8408ccc842ecac157fbc92540f2d (table default.table_fdbead99862d49af98df44683e830bf5 [id=85b633c4801d49bd9ad9b944b178e683])
I20260620 14:48:06.786311 10060 tablet_loader.cc:96] loaded metadata for tablet 7a78d61e26c645b6bd82b6070c677b98 (table default.table_d2959bb621be429eb5af827263887798 [id=ddb41391569b4a11b4ad85335ca24ddb])
I20260620 14:48:06.786607 10060 tablet_loader.cc:96] loaded metadata for tablet 8caaa1b5e0384a6ab49b9fd7162896c8 (table default.table_bb493f9370e74bafae7b1e42f5c5f770 [id=6a722b39b30e45649b7b70c32c9e2260])
I20260620 14:48:06.786877 10060 tablet_loader.cc:96] loaded metadata for tablet 8e2d76b1afb147088869a6180d5bc03e (table default.table_105950e097bf4cbda12e7532557966b2 [id=34076de884f942fcb696a9c9524941e7])
I20260620 14:48:06.787250 10060 tablet_loader.cc:96] loaded metadata for tablet a8aa5397f7914b83a1d94bd14455f98d (table default.table_1ea7c21a49a443c29bd5578c5950c27f [id=bfa17da52a874fa1b587ad18d04cd740])
I20260620 14:48:06.787655 10060 tablet_loader.cc:96] loaded metadata for tablet bd541e6a431348c7a506611681730fc5 (table default.table_a901d915c377429a9e43cfcaf071e7d3 [id=c65e926af55d4fbba6c42f4d2ddbb397])
I20260620 14:48:06.788823 10060 tablet_loader.cc:96] loaded metadata for tablet eb6d101c1a5444cabf7c966c7ac7134e (table default.table_fe5ad6a8d59b4751bcbb6e1d0d4baedb [id=c514aca79062490a8b6a18021b07b2ff])
I20260620 14:48:06.789142 10060 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:48:06.790771 10060 catalog_manager.cc:1259] Loaded cluster ID: 700994c053c643c896af12c77a108604
I20260620 14:48:06.790870 10060 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:48:06.792452 10060 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:48:06.793681 10060 catalog_manager.cc:5879] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52: Loaded TSK: 0
I20260620 14:48:06.794642 10060 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 14:48:06.796060 10060 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260620 14:48:06.797551 10060 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: 27
I20260620 14:48:06.822266 9841 master_service.cc:946] ReplaceTablet: received request to replace tablet 309a0915648643ada08981a11e7a1e59 from {username='slave'} at 127.0.0.1:48398
I20260620 14:48:06.822474 9840 master_service.cc:946] ReplaceTablet: received request to replace tablet 1ad679f398ab41a1bc207b016648cbe8 from {username='slave'} at 127.0.0.1:48398
I20260620 14:48:06.823050 9839 master_service.cc:946] ReplaceTablet: received request to replace tablet 753328bb98be4189abdbf6d60ef95fc9 from {username='slave'} at 127.0.0.1:48398
I20260620 14:48:06.823474 9834 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48398:
table { table_name: "default.Table_a901d915c377429a9e43cfcaf071e7d3" } modify_external_catalogs: true
I20260620 14:48:06.823871 9834 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48398:
table { table_name: "default.Table_a901d915c377429a9e43cfcaf071e7d3" } modify_external_catalogs: true
I20260620 14:48:06.825198 9838 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48398:
table { table_name: "default.Table_105950e097bf4cbda12e7532557966b2" } modify_external_catalogs: true
I20260620 14:48:06.825521 9838 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48398:
table { table_name: "default.Table_105950e097bf4cbda12e7532557966b2" } modify_external_catalogs: true
I20260620 14:48:06.825933 9836 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48398:
table { table_name: "default.Table_4ab72ecdb6d540508f6f4b250020b540" } modify_external_catalogs: true
I20260620 14:48:06.826300 9836 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48398:
table { table_name: "default.Table_4ab72ecdb6d540508f6f4b250020b540" } modify_external_catalogs: true
I20260620 14:48:06.827090 9833 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48398:
table { table_name: "default.Table_e8372b71bacb4865b4360a50af59d323" } new_table_name: "default.Table_0397b5018c12412d8adff6a6eef71ab4" modify_external_catalogs: true
I20260620 14:48:06.830034 9832 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48398:
table { table_name: "default.Table_fdbead99862d49af98df44683e830bf5" } new_table_name: "default.Table_d287e3d931c34a68ae38252d5c848e4c" modify_external_catalogs: true
I20260620 14:48:06.834013 9841 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52: Sending DeleteTablet for 3 replicas of tablet 309a0915648643ada08981a11e7a1e59
I20260620 14:48:06.827171 9837 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48398:
name: "default.Table_fdfd2b5f110441cb9e549b5eba106701"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:48:06.831609 9835 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48398:
table { table_name: "default.Table_98318448fcf3484cb76812dad2975098" } new_table_name: "default.Table_b4a1333c5cb24d1093488dce20083354" modify_external_catalogs: true
I20260620 14:48:06.834614 9839 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52: Sending DeleteTablet for 3 replicas of tablet 753328bb98be4189abdbf6d60ef95fc9
I20260620 14:48:06.837657 9895 catalog_manager.cc:2709] Deleting table default.table_2d00c2dfdbfe428a8de80587e6f6e918 [id=a17882ca0acc459caae49f8238c7df14] in response to Hive Metastore notification log event 28
W20260620 14:48:06.838091 9895 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 28 DROP_TABLE default.table_2d00c2dfdbfe428a8de80587e6f6e918: Not found: the table does not exist: table_id: "a17882ca0acc459caae49f8238c7df14" table_name: "default.table_2d00c2dfdbfe428a8de80587e6f6e918"
F20260620 14:48:06.838194 9895 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 28): 28 CREATE_TABLE default.table_154fc524efb24453bdb6d735e4c741e9
*** Check failure stack trace: ***
@ 0x7f34ef8319ad google::LogMessage::Fail() at ??:0
@ 0x7f34ef83488a google::LogMessage::SendToLog() at ??:0
I20260620 14:48:06.844735 9841 catalog_manager.cc:6565] ReplaceTablet: tablet 309a0915648643ada08981a11e7a1e59 deleted and replaced by tablet e29636c50e7f49a9b086c475b2b8cc2f
I20260620 14:48:06.845345 9840 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dd308569015348a7a19ba4a560de6d52: Sending DeleteTablet for 3 replicas of tablet 1ad679f398ab41a1bc207b016648cbe8
I20260620 14:48:06.845841 9840 catalog_manager.cc:6565] ReplaceTablet: tablet 1ad679f398ab41a1bc207b016648cbe8 deleted and replaced by tablet 7fe9685389a04338a0c2ff23cac957d3
I20260620 14:48:06.845885 9841 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48398:
name: "default.Table_63c7519d9a2a45b980b2d44a70aec200"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:48:06.846251 9840 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48398:
name: "default.Table_96a3abe199c94222aea451130599b401"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
@ 0x7f34ef8314de google::LogMessage::Flush() at ??:0
@ 0x7f34ef8316d1 google::LogMessage::~LogMessage() at ??:0
I20260620 14:48:06.850245 9839 catalog_manager.cc:6565] ReplaceTablet: tablet 753328bb98be4189abdbf6d60ef95fc9 deleted and replaced by tablet 776892be9b4b49b58d9812970e51d1e5
I20260620 14:48:06.851056 9839 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48398:
name: "default.Table_2d00c2dfdbfe428a8de80587e6f6e918"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
@ 0x7f35053cfba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260620 14:48:06.868909 8775 tablet_service.cc:1467] Processing CreateTablet for tablet 31e1bc87e526443e93e1f7d9b79659a7 (DEFAULT_TABLE table=default.table_0eb776233cee4294b6c96ec556447663 [id=3420fc1c9c8b45f49aeaa7b4c97da51e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:48:06.869444 8775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31e1bc87e526443e93e1f7d9b79659a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:48:06.869801 8779 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ad679f398ab41a1bc207b016648cbe8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7fe9685389a04338a0c2ff23cac957d3) from {username='slave'} at 127.0.0.1:38918
I20260620 14:48:06.871480 8780 tablet_service.cc:1467] Processing CreateTablet for tablet a8aa5397f7914b83a1d94bd14455f98d (DEFAULT_TABLE table=default.table_1ea7c21a49a443c29bd5578c5950c27f [id=bfa17da52a874fa1b587ad18d04cd740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:48:06.872021 8780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8aa5397f7914b83a1d94bd14455f98d. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f35053ce901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260620 14:48:06.868284 8776 tablet_service.cc:1514] Processing DeleteTablet for tablet 309a0915648643ada08981a11e7a1e59 with delete_type TABLET_DATA_DELETED (replaced by tablet e29636c50e7f49a9b086c475b2b8cc2f) from {username='slave'} at 127.0.0.1:38918
I20260620 14:48:06.878047 8778 tablet_service.cc:1467] Processing CreateTablet for tablet 1c7ec92b27c444b2bc03a1993959de26 (DEFAULT_TABLE table=default.table_8cc72697ee4f4200a5f57a19280315ee [id=1db81c7e90894c5fac0e8fe34d1d4441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:48:06.880203 8778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c7ec92b27c444b2bc03a1993959de26. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f35053d566c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260620 14:48:06.881098 8777 tablet_service.cc:1514] Processing DeleteTablet for tablet 753328bb98be4189abdbf6d60ef95fc9 with delete_type TABLET_DATA_DELETED (replaced by tablet 776892be9b4b49b58d9812970e51d1e5) from {username='slave'} at 127.0.0.1:38918
@ 0x7f35053d54e9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
I20260620 14:48:06.890472 8635 tablet_service.cc:1467] Processing CreateTablet for tablet e29636c50e7f49a9b086c475b2b8cc2f (DEFAULT_TABLE table=default.table_563392802bec4e688c0eabd46ab1fd5c [id=7e71694fb4a948f09c01863575227fda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:48:06.890650 8638 tablet_service.cc:1514] Processing DeleteTablet for tablet 753328bb98be4189abdbf6d60ef95fc9 with delete_type TABLET_DATA_DELETED (replaced by tablet 776892be9b4b49b58d9812970e51d1e5) from {username='slave'} at 127.0.0.1:53894
I20260620 14:48:06.891156 8641 tablet_service.cc:1514] Processing DeleteTablet for tablet 309a0915648643ada08981a11e7a1e59 with delete_type TABLET_DATA_DELETED (replaced by tablet e29636c50e7f49a9b086c475b2b8cc2f) from {username='slave'} at 127.0.0.1:53894
I20260620 14:48:06.891420 8637 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ad679f398ab41a1bc207b016648cbe8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7fe9685389a04338a0c2ff23cac957d3) from {username='slave'} at 127.0.0.1:53894
I20260620 14:48:06.891607 8633 tablet_service.cc:1467] Processing CreateTablet for tablet 776892be9b4b49b58d9812970e51d1e5 (DEFAULT_TABLE table=default.table_98318448fcf3484cb76812dad2975098 [id=862dd3cee25c40eead9feb394a8b58b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:48:06.891777 8642 tablet_service.cc:1467] Processing CreateTablet for tablet a8aa5397f7914b83a1d94bd14455f98d (DEFAULT_TABLE table=default.table_1ea7c21a49a443c29bd5578c5950c27f [id=bfa17da52a874fa1b587ad18d04cd740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:48:06.891165 8635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e29636c50e7f49a9b086c475b2b8cc2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:48:06.892117 8777 tablet_service.cc:1467] Processing CreateTablet for tablet e29636c50e7f49a9b086c475b2b8cc2f (DEFAULT_TABLE table=default.table_563392802bec4e688c0eabd46ab1fd5c [id=7e71694fb4a948f09c01863575227fda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:48:06.892328 8639 tablet_service.cc:1467] Processing CreateTablet for tablet 31e1bc87e526443e93e1f7d9b79659a7 (DEFAULT_TABLE table=default.table_0eb776233cee4294b6c96ec556447663 [id=3420fc1c9c8b45f49aeaa7b4c97da51e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:48:06.892493 8777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e29636c50e7f49a9b086c475b2b8cc2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:48:06.892655 8639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31e1bc87e526443e93e1f7d9b79659a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:48:06.893793 8776 tablet_service.cc:1467] Processing CreateTablet for tablet 17c70368ee9e4328bd780654572e1905 (DEFAULT_TABLE table=default.table_154fc524efb24453bdb6d735e4c741e9 [id=3b08ae3b47fd46cab8ef5a41bb0bc5d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:48:06.894131 8776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17c70368ee9e4328bd780654572e1905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:48:06.895368 8633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 776892be9b4b49b58d9812970e51d1e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:48:06.895655 8774 tablet_service.cc:1467] Processing CreateTablet for tablet 76cc8408ccc842ecac157fbc92540f2d (DEFAULT_TABLE table=default.table_fdbead99862d49af98df44683e830bf5 [id=85b633c4801d49bd9ad9b944b178e683]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:48:06.896027 8774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76cc8408ccc842ecac157fbc92540f2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:48:06.897078 8640 tablet_service.cc:1467] Processing CreateTablet for tablet 1c7ec92b27c444b2bc03a1993959de26 (DEFAULT_TABLE table=default.table_8cc72697ee4f4200a5f57a19280315ee [id=1db81c7e90894c5fac0e8fe34d1d4441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:48:06.899242 8640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c7ec92b27c444b2bc03a1993959de26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:48:06.901185 8771 tablet_service.cc:1467] Processing CreateTablet for tablet 7fe9685389a04338a0c2ff23cac957d3 (DEFAULT_TABLE table=default.table_19c624001d444b7b9939e22128c594aa [id=98d2e7b647544a97b50827a0cb2799a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:48:06.901726 8771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fe9685389a04338a0c2ff23cac957d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:48:06.897588 8636 tablet_service.cc:1467] Processing CreateTablet for tablet 76cc8408ccc842ecac157fbc92540f2d (DEFAULT_TABLE table=default.table_fdbead99862d49af98df44683e830bf5 [id=85b633c4801d49bd9ad9b944b178e683]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:48:06.905236 8636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76cc8408ccc842ecac157fbc92540f2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:48:06.905515 8773 tablet_service.cc:1467] Processing CreateTablet for tablet 776892be9b4b49b58d9812970e51d1e5 (DEFAULT_TABLE table=default.table_98318448fcf3484cb76812dad2975098 [id=862dd3cee25c40eead9feb394a8b58b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:48:06.906085 8773 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 776892be9b4b49b58d9812970e51d1e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:48:06.897908 8634 tablet_service.cc:1467] Processing CreateTablet for tablet 17c70368ee9e4328bd780654572e1905 (DEFAULT_TABLE table=default.table_154fc524efb24453bdb6d735e4c741e9 [id=3b08ae3b47fd46cab8ef5a41bb0bc5d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:48:06.909193 8634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17c70368ee9e4328bd780654572e1905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:48:06.898233 8632 tablet_service.cc:1467] Processing CreateTablet for tablet 16ecb528da2746fda47d12a11af8b774 (DEFAULT_TABLE table=default.table_e8372b71bacb4865b4360a50af59d323 [id=9c1e21a6c9244efba2e86bfa28264a0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:48:06.912987 8772 tablet_service.cc:1467] Processing CreateTablet for tablet 16ecb528da2746fda47d12a11af8b774 (DEFAULT_TABLE table=default.table_e8372b71bacb4865b4360a50af59d323 [id=9c1e21a6c9244efba2e86bfa28264a0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:48:06.913245 8632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16ecb528da2746fda47d12a11af8b774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:48:06.913584 8772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16ecb528da2746fda47d12a11af8b774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:48:06.898576 8631 tablet_service.cc:1467] Processing CreateTablet for tablet 7fe9685389a04338a0c2ff23cac957d3 (DEFAULT_TABLE table=default.table_19c624001d444b7b9939e22128c594aa [id=98d2e7b647544a97b50827a0cb2799a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:48:06.917222 8631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fe9685389a04338a0c2ff23cac957d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:48:06.920928 8642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8aa5397f7914b83a1d94bd14455f98d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:48:06.925194 10091 tablet_replica.cc:330] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c: stopping tablet replica
I20260620 14:48:06.925472 10091 raft_consensus.cc:2229] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:48:06.925926 10091 raft_consensus.cc:2258] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:48:06.926671 10091 ts_tablet_manager.cc:1905] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:48:06.932927 10089 tablet_bootstrap.cc:492] T 31e1bc87e526443e93e1f7d9b79659a7 P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:48:06.935282 10089 tablet_bootstrap.cc:654] T 31e1bc87e526443e93e1f7d9b79659a7 P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
@ 0x7f34f245beaf kudu::Thread::SuperviseThread() at ??:0
I20260620 14:48:06.938686 10091 ts_tablet_manager.cc:1918] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:48:06.938798 10091 log.cc:1196] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal/wals/1ad679f398ab41a1bc207b016648cbe8
I20260620 14:48:06.939229 10091 ts_tablet_manager.cc:1939] T 1ad679f398ab41a1bc207b016648cbe8 P 36236dd5bd604ba2819038e525a3790c: Deleting consensus metadata
@ 0x7f34f57356db start_thread at ??:0
I20260620 14:48:06.940310 9828 catalog_manager.cc:4841] TS 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): tablet 1ad679f398ab41a1bc207b016648cbe8 (table default.table_19c624001d444b7b9939e22128c594aa [id=98d2e7b647544a97b50827a0cb2799a0]) successfully deleted
I20260620 14:48:06.941298 10094 tablet_bootstrap.cc:492] T e29636c50e7f49a9b086c475b2b8cc2f P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:48:06.942916 10091 tablet_replica.cc:330] T 309a0915648643ada08981a11e7a1e59 P 36236dd5bd604ba2819038e525a3790c: stopping tablet replica
I20260620 14:48:06.943127 10091 raft_consensus.cc:2229] T 309a0915648643ada08981a11e7a1e59 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:48:06.943238 10094 tablet_bootstrap.cc:654] T e29636c50e7f49a9b086c475b2b8cc2f P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:48:06.943301 10091 raft_consensus.cc:2258] T 309a0915648643ada08981a11e7a1e59 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:48:06.943877 10091 ts_tablet_manager.cc:1905] T 309a0915648643ada08981a11e7a1e59 P 36236dd5bd604ba2819038e525a3790c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:48:06.951174 8914 tablet_service.cc:1514] Processing DeleteTablet for tablet 309a0915648643ada08981a11e7a1e59 with delete_type TABLET_DATA_DELETED (replaced by tablet e29636c50e7f49a9b086c475b2b8cc2f) from {username='slave'} at 127.0.0.1:36850
I20260620 14:48:06.951828 10098 tablet_replica.cc:330] T 309a0915648643ada08981a11e7a1e59 P 6c99207e35f8463292d71c371c9546b4: stopping tablet replica
I20260620 14:48:06.952075 10098 raft_consensus.cc:2229] T 309a0915648643ada08981a11e7a1e59 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:48:06.952111 8914 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ad679f398ab41a1bc207b016648cbe8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7fe9685389a04338a0c2ff23cac957d3) from {username='slave'} at 127.0.0.1:36850
I20260620 14:48:06.952318 10098 raft_consensus.cc:2258] T 309a0915648643ada08981a11e7a1e59 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:48:06.952662 8914 tablet_service.cc:1514] Processing DeleteTablet for tablet 753328bb98be4189abdbf6d60ef95fc9 with delete_type TABLET_DATA_DELETED (replaced by tablet 776892be9b4b49b58d9812970e51d1e5) from {username='slave'} at 127.0.0.1:36850
I20260620 14:48:06.953016 10098 ts_tablet_manager.cc:1905] T 309a0915648643ada08981a11e7a1e59 P 6c99207e35f8463292d71c371c9546b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:48:06.953361 8914 tablet_service.cc:1467] Processing CreateTablet for tablet a8aa5397f7914b83a1d94bd14455f98d (DEFAULT_TABLE table=default.table_1ea7c21a49a443c29bd5578c5950c27f [id=bfa17da52a874fa1b587ad18d04cd740]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:48:06.953754 8914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8aa5397f7914b83a1d94bd14455f98d. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f34ee6cb61f clone at ??:0
I20260620 14:48:06.963459 10094 tablet_bootstrap.cc:492] T e29636c50e7f49a9b086c475b2b8cc2f P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:48:06.963660 10094 ts_tablet_manager.cc:1397] T e29636c50e7f49a9b086c475b2b8cc2f P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.003s
I20260620 14:48:06.964586 10094 raft_consensus.cc:348] T e29636c50e7f49a9b086c475b2b8cc2f P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:06.964777 8913 tablet_service.cc:1467] Processing CreateTablet for tablet 31e1bc87e526443e93e1f7d9b79659a7 (DEFAULT_TABLE table=default.table_0eb776233cee4294b6c96ec556447663 [id=3420fc1c9c8b45f49aeaa7b4c97da51e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:48:06.964897 10094 raft_consensus.cc:374] T e29636c50e7f49a9b086c475b2b8cc2f P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:48:06.964990 10094 raft_consensus.cc:729] T e29636c50e7f49a9b086c475b2b8cc2f P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:48:06.965216 8913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31e1bc87e526443e93e1f7d9b79659a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:48:06.965216 10094 consensus_queue.cc:260] T e29636c50e7f49a9b086c475b2b8cc2f P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:06.967681 10094 ts_tablet_manager.cc:1428] T e29636c50e7f49a9b086c475b2b8cc2f P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260620 14:48:06.968789 10094 tablet_bootstrap.cc:492] T 776892be9b4b49b58d9812970e51d1e5 P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:48:06.970495 10094 tablet_bootstrap.cc:654] T 776892be9b4b49b58d9812970e51d1e5 P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:48:06.972074 8913 tablet_service.cc:1467] Processing CreateTablet for tablet 1c7ec92b27c444b2bc03a1993959de26 (DEFAULT_TABLE table=default.table_8cc72697ee4f4200a5f57a19280315ee [id=1db81c7e90894c5fac0e8fe34d1d4441]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:48:06.972532 8913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c7ec92b27c444b2bc03a1993959de26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:48:06.973995 10094 tablet_bootstrap.cc:492] T 776892be9b4b49b58d9812970e51d1e5 P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:48:06.974165 10094 ts_tablet_manager.cc:1397] T 776892be9b4b49b58d9812970e51d1e5 P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260620 14:48:06.974696 8912 tablet_service.cc:1467] Processing CreateTablet for tablet 76cc8408ccc842ecac157fbc92540f2d (DEFAULT_TABLE table=default.table_fdbead99862d49af98df44683e830bf5 [id=85b633c4801d49bd9ad9b944b178e683]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:48:06.974924 10094 raft_consensus.cc:348] T 776892be9b4b49b58d9812970e51d1e5 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:06.975111 8912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76cc8408ccc842ecac157fbc92540f2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:48:06.975164 10094 raft_consensus.cc:374] T 776892be9b4b49b58d9812970e51d1e5 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:48:06.975232 10094 raft_consensus.cc:729] T 776892be9b4b49b58d9812970e51d1e5 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:48:06.975449 10094 consensus_queue.cc:260] T 776892be9b4b49b58d9812970e51d1e5 P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:06.977290 10094 ts_tablet_manager.cc:1428] T 776892be9b4b49b58d9812970e51d1e5 P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260620 14:48:06.978550 10094 tablet_bootstrap.cc:492] T 17c70368ee9e4328bd780654572e1905 P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:48:06.980605 10094 tablet_bootstrap.cc:654] T 17c70368ee9e4328bd780654572e1905 P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:48:06.981139 10092 tablet_replica.cc:330] T 753328bb98be4189abdbf6d60ef95fc9 P c0e6c57ab91e42bf9be3739c816916c0: stopping tablet replica
I20260620 14:48:06.981351 10092 raft_consensus.cc:2229] T 753328bb98be4189abdbf6d60ef95fc9 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:48:06.981585 10092 raft_consensus.cc:2258] T 753328bb98be4189abdbf6d60ef95fc9 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:48:06.982187 10092 ts_tablet_manager.cc:1905] T 753328bb98be4189abdbf6d60ef95fc9 P c0e6c57ab91e42bf9be3739c816916c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:48:06.985603 10089 tablet_bootstrap.cc:492] T 31e1bc87e526443e93e1f7d9b79659a7 P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:48:06.985733 10089 ts_tablet_manager.cc:1397] T 31e1bc87e526443e93e1f7d9b79659a7 P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.053s user 0.006s sys 0.003s
I20260620 14:48:06.986447 10089 raft_consensus.cc:348] T 31e1bc87e526443e93e1f7d9b79659a7 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:06.986671 10089 raft_consensus.cc:374] T 31e1bc87e526443e93e1f7d9b79659a7 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:48:06.986742 10089 raft_consensus.cc:729] T 31e1bc87e526443e93e1f7d9b79659a7 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:48:06.986963 10089 consensus_queue.cc:260] T 31e1bc87e526443e93e1f7d9b79659a7 P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:06.990348 10094 tablet_bootstrap.cc:492] T 17c70368ee9e4328bd780654572e1905 P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:48:06.990514 10094 ts_tablet_manager.cc:1397] T 17c70368ee9e4328bd780654572e1905 P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.006s
I20260620 14:48:06.990962 10089 ts_tablet_manager.cc:1428] T 31e1bc87e526443e93e1f7d9b79659a7 P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260620 14:48:06.991454 10094 raft_consensus.cc:348] T 17c70368ee9e4328bd780654572e1905 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:06.991703 10094 raft_consensus.cc:374] T 17c70368ee9e4328bd780654572e1905 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:48:06.991791 10094 raft_consensus.cc:729] T 17c70368ee9e4328bd780654572e1905 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:48:06.992007 10094 consensus_queue.cc:260] T 17c70368ee9e4328bd780654572e1905 P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:06.995157 10094 ts_tablet_manager.cc:1428] T 17c70368ee9e4328bd780654572e1905 P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20260620 14:48:06.996132 8915 tablet_service.cc:1467] Processing CreateTablet for tablet 17c70368ee9e4328bd780654572e1905 (DEFAULT_TABLE table=default.table_154fc524efb24453bdb6d735e4c741e9 [id=3b08ae3b47fd46cab8ef5a41bb0bc5d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:48:06.996508 10094 tablet_bootstrap.cc:492] T 7fe9685389a04338a0c2ff23cac957d3 P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:48:06.998533 10094 tablet_bootstrap.cc:654] T 7fe9685389a04338a0c2ff23cac957d3 P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:48:06.999164 8912 tablet_service.cc:1467] Processing CreateTablet for tablet e29636c50e7f49a9b086c475b2b8cc2f (DEFAULT_TABLE table=default.table_563392802bec4e688c0eabd46ab1fd5c [id=7e71694fb4a948f09c01863575227fda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:48:06.999650 10089 tablet_bootstrap.cc:492] T e29636c50e7f49a9b086c475b2b8cc2f P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:48:07.008623 10094 tablet_bootstrap.cc:492] T 7fe9685389a04338a0c2ff23cac957d3 P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:48:07.008845 10094 ts_tablet_manager.cc:1397] T 7fe9685389a04338a0c2ff23cac957d3 P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.003s
I20260620 14:48:07.009218 8915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17c70368ee9e4328bd780654572e1905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:48:07.009752 10094 raft_consensus.cc:348] T 7fe9685389a04338a0c2ff23cac957d3 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.008915 8911 tablet_service.cc:1467] Processing CreateTablet for tablet 776892be9b4b49b58d9812970e51d1e5 (DEFAULT_TABLE table=default.table_98318448fcf3484cb76812dad2975098 [id=862dd3cee25c40eead9feb394a8b58b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:48:07.010056 10094 raft_consensus.cc:374] T 7fe9685389a04338a0c2ff23cac957d3 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:48:07.010144 10094 raft_consensus.cc:729] T 7fe9685389a04338a0c2ff23cac957d3 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:48:07.010515 8910 tablet_service.cc:1467] Processing CreateTablet for tablet 16ecb528da2746fda47d12a11af8b774 (DEFAULT_TABLE table=default.table_e8372b71bacb4865b4360a50af59d323 [id=9c1e21a6c9244efba2e86bfa28264a0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:48:07.010486 10094 consensus_queue.cc:260] T 7fe9685389a04338a0c2ff23cac957d3 P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.011384 8909 tablet_service.cc:1467] Processing CreateTablet for tablet 7fe9685389a04338a0c2ff23cac957d3 (DEFAULT_TABLE table=default.table_19c624001d444b7b9939e22128c594aa [id=98d2e7b647544a97b50827a0cb2799a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 14:48:07.013665 10094 ts_tablet_manager.cc:1428] T 7fe9685389a04338a0c2ff23cac957d3 P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260620 14:48:07.015157 10094 tablet_bootstrap.cc:492] T 16ecb528da2746fda47d12a11af8b774 P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:48:07.017334 10094 tablet_bootstrap.cc:654] T 16ecb528da2746fda47d12a11af8b774 P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:48:07.021153 10094 tablet_bootstrap.cc:492] T 16ecb528da2746fda47d12a11af8b774 P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:48:07.021333 10094 ts_tablet_manager.cc:1397] T 16ecb528da2746fda47d12a11af8b774 P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.003s
I20260620 14:48:07.022230 10094 raft_consensus.cc:348] T 16ecb528da2746fda47d12a11af8b774 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.022526 10094 raft_consensus.cc:374] T 16ecb528da2746fda47d12a11af8b774 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:48:07.022625 10094 raft_consensus.cc:729] T 16ecb528da2746fda47d12a11af8b774 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:48:07.022928 10094 consensus_queue.cc:260] T 16ecb528da2746fda47d12a11af8b774 P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.026320 10094 ts_tablet_manager.cc:1428] T 16ecb528da2746fda47d12a11af8b774 P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260620 14:48:07.027738 10094 tablet_bootstrap.cc:492] T 76cc8408ccc842ecac157fbc92540f2d P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:48:07.028802 8912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e29636c50e7f49a9b086c475b2b8cc2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:48:07.029963 10094 tablet_bootstrap.cc:654] T 76cc8408ccc842ecac157fbc92540f2d P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:48:07.031080 8909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fe9685389a04338a0c2ff23cac957d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:48:07.038123 8911 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 776892be9b4b49b58d9812970e51d1e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:48:07.038390 10094 tablet_bootstrap.cc:492] T 76cc8408ccc842ecac157fbc92540f2d P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:48:07.038597 10094 ts_tablet_manager.cc:1397] T 76cc8408ccc842ecac157fbc92540f2d P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.010s
I20260620 14:48:07.039592 10094 raft_consensus.cc:348] T 76cc8408ccc842ecac157fbc92540f2d P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.039836 10094 raft_consensus.cc:374] T 76cc8408ccc842ecac157fbc92540f2d P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:48:07.041294 10094 raft_consensus.cc:729] T 76cc8408ccc842ecac157fbc92540f2d P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:48:07.041673 10094 consensus_queue.cc:260] T 76cc8408ccc842ecac157fbc92540f2d P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.043006 10089 tablet_bootstrap.cc:654] T e29636c50e7f49a9b086c475b2b8cc2f P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:48:07.043780 10094 ts_tablet_manager.cc:1428] T 76cc8408ccc842ecac157fbc92540f2d P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20260620 14:48:07.045356 10094 tablet_bootstrap.cc:492] T a8aa5397f7914b83a1d94bd14455f98d P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:48:07.045975 8910 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16ecb528da2746fda47d12a11af8b774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 14:48:07.047719 10094 tablet_bootstrap.cc:654] T a8aa5397f7914b83a1d94bd14455f98d P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:48:07.051352 10100 tablet_bootstrap.cc:492] T a8aa5397f7914b83a1d94bd14455f98d P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:48:07.062829 10091 ts_tablet_manager.cc:1918] T 309a0915648643ada08981a11e7a1e59 P 36236dd5bd604ba2819038e525a3790c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:48:07.062976 10091 log.cc:1196] T 309a0915648643ada08981a11e7a1e59 P 36236dd5bd604ba2819038e525a3790c: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal/wals/309a0915648643ada08981a11e7a1e59
I20260620 14:48:07.063392 10091 ts_tablet_manager.cc:1939] T 309a0915648643ada08981a11e7a1e59 P 36236dd5bd604ba2819038e525a3790c: Deleting consensus metadata
I20260620 14:48:07.065135 10089 tablet_bootstrap.cc:492] T e29636c50e7f49a9b086c475b2b8cc2f P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:48:07.065279 10089 ts_tablet_manager.cc:1397] T e29636c50e7f49a9b086c475b2b8cc2f P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.066s user 0.004s sys 0.000s
I20260620 14:48:07.066047 10089 raft_consensus.cc:348] T e29636c50e7f49a9b086c475b2b8cc2f P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.066280 10089 raft_consensus.cc:374] T e29636c50e7f49a9b086c475b2b8cc2f P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:48:07.066376 10089 raft_consensus.cc:729] T e29636c50e7f49a9b086c475b2b8cc2f P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:48:07.066632 10089 consensus_queue.cc:260] T e29636c50e7f49a9b086c475b2b8cc2f P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.067242 10089 ts_tablet_manager.cc:1428] T e29636c50e7f49a9b086c475b2b8cc2f P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 14:48:07.069109 10092 ts_tablet_manager.cc:1918] T 753328bb98be4189abdbf6d60ef95fc9 P c0e6c57ab91e42bf9be3739c816916c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:48:07.069262 10092 log.cc:1196] T 753328bb98be4189abdbf6d60ef95fc9 P c0e6c57ab91e42bf9be3739c816916c0: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/wal/wals/753328bb98be4189abdbf6d60ef95fc9
I20260620 14:48:07.070791 10092 ts_tablet_manager.cc:1939] T 753328bb98be4189abdbf6d60ef95fc9 P c0e6c57ab91e42bf9be3739c816916c0: Deleting consensus metadata
I20260620 14:48:07.070875 10094 tablet_bootstrap.cc:492] T a8aa5397f7914b83a1d94bd14455f98d P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:48:07.071058 10094 ts_tablet_manager.cc:1397] T a8aa5397f7914b83a1d94bd14455f98d P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.006s
I20260620 14:48:07.072021 10094 raft_consensus.cc:348] T a8aa5397f7914b83a1d94bd14455f98d P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.072330 10094 raft_consensus.cc:374] T a8aa5397f7914b83a1d94bd14455f98d P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:48:07.072455 10094 raft_consensus.cc:729] T a8aa5397f7914b83a1d94bd14455f98d P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:48:07.072722 10094 consensus_queue.cc:260] T a8aa5397f7914b83a1d94bd14455f98d P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.073303 10092 tablet_replica.cc:330] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0: stopping tablet replica
I20260620 14:48:07.073511 10092 raft_consensus.cc:2229] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:48:07.073839 10092 raft_consensus.cc:2258] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:48:07.074421 10092 ts_tablet_manager.cc:1905] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:48:07.075723 10094 ts_tablet_manager.cc:1428] T a8aa5397f7914b83a1d94bd14455f98d P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260620 14:48:07.075861 10096 raft_consensus.cc:482] T 31e1bc87e526443e93e1f7d9b79659a7 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:07.076036 10096 raft_consensus.cc:504] T 31e1bc87e526443e93e1f7d9b79659a7 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.077116 10096 leader_election.cc:288] T 31e1bc87e526443e93e1f7d9b79659a7 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:48:07.077788 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31e1bc87e526443e93e1f7d9b79659a7" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:48:07.078136 10094 tablet_bootstrap.cc:492] T 31e1bc87e526443e93e1f7d9b79659a7 P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
W20260620 14:48:07.078392 8733 leader_election.cc:341] T 31e1bc87e526443e93e1f7d9b79659a7 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821): Illegal state: must be running to vote when last-logged opid is not known
I20260620 14:48:07.080513 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31e1bc87e526443e93e1f7d9b79659a7" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4" is_pre_election: true
I20260620 14:48:07.083300 10094 tablet_bootstrap.cc:654] T 31e1bc87e526443e93e1f7d9b79659a7 P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
W20260620 14:48:07.083277 8733 leader_election.cc:341] T 31e1bc87e526443e93e1f7d9b79659a7 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260620 14:48:07.083421 8733 leader_election.cc:302] T 31e1bc87e526443e93e1f7d9b79659a7 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c; no voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0
I20260620 14:48:07.083945 10096 raft_consensus.cc:2726] T 31e1bc87e526443e93e1f7d9b79659a7 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 14:48:07.084926 10091 tablet_replica.cc:330] T 753328bb98be4189abdbf6d60ef95fc9 P 36236dd5bd604ba2819038e525a3790c: stopping tablet replica
I20260620 14:48:07.085067 10089 tablet_bootstrap.cc:492] T 17c70368ee9e4328bd780654572e1905 P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:48:07.085139 10091 raft_consensus.cc:2229] T 753328bb98be4189abdbf6d60ef95fc9 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:48:07.085335 10091 raft_consensus.cc:2258] T 753328bb98be4189abdbf6d60ef95fc9 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:48:07.086334 10091 ts_tablet_manager.cc:1905] T 753328bb98be4189abdbf6d60ef95fc9 P 36236dd5bd604ba2819038e525a3790c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:48:07.086772 10089 tablet_bootstrap.cc:654] T 17c70368ee9e4328bd780654572e1905 P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:48:07.088953 9977 raft_consensus.cc:482] T 16ecb528da2746fda47d12a11af8b774 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:07.089123 9977 raft_consensus.cc:504] T 16ecb528da2746fda47d12a11af8b774 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.089747 9977 leader_election.cc:288] T 16ecb528da2746fda47d12a11af8b774 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:48:07.090548 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16ecb528da2746fda47d12a11af8b774" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4" is_pre_election: true
I20260620 14:48:07.090958 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16ecb528da2746fda47d12a11af8b774" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
W20260620 14:48:07.091073 8596 leader_election.cc:341] T 16ecb528da2746fda47d12a11af8b774 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Illegal state: must be running to vote when last-logged opid is not known
W20260620 14:48:07.091516 8598 leader_election.cc:341] T 16ecb528da2746fda47d12a11af8b774 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Illegal state: must be running to vote when last-logged opid is not known
I20260620 14:48:07.091656 8598 leader_election.cc:302] T 16ecb528da2746fda47d12a11af8b774 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:48:07.092020 9977 raft_consensus.cc:2726] T 16ecb528da2746fda47d12a11af8b774 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 14:48:07.093068 10100 tablet_bootstrap.cc:654] T a8aa5397f7914b83a1d94bd14455f98d P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:48:07.093762 10092 ts_tablet_manager.cc:1918] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:48:07.093912 10092 log.cc:1196] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/wal/wals/309a0915648643ada08981a11e7a1e59
I20260620 14:48:07.094362 10092 ts_tablet_manager.cc:1939] T 309a0915648643ada08981a11e7a1e59 P c0e6c57ab91e42bf9be3739c816916c0: Deleting consensus metadata
I20260620 14:48:07.095578 10092 tablet_replica.cc:330] T 1ad679f398ab41a1bc207b016648cbe8 P c0e6c57ab91e42bf9be3739c816916c0: stopping tablet replica
I20260620 14:48:07.095899 10092 raft_consensus.cc:2229] T 1ad679f398ab41a1bc207b016648cbe8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:48:07.096158 10092 raft_consensus.cc:2258] T 1ad679f398ab41a1bc207b016648cbe8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:48:07.096688 10092 ts_tablet_manager.cc:1905] T 1ad679f398ab41a1bc207b016648cbe8 P c0e6c57ab91e42bf9be3739c816916c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:48:07.097666 10098 ts_tablet_manager.cc:1918] T 309a0915648643ada08981a11e7a1e59 P 6c99207e35f8463292d71c371c9546b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:48:07.097715 10091 ts_tablet_manager.cc:1918] T 753328bb98be4189abdbf6d60ef95fc9 P 36236dd5bd604ba2819038e525a3790c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:48:07.097792 10098 log.cc:1196] T 309a0915648643ada08981a11e7a1e59 P 6c99207e35f8463292d71c371c9546b4: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal/wals/309a0915648643ada08981a11e7a1e59
I20260620 14:48:07.097828 10091 log.cc:1196] T 753328bb98be4189abdbf6d60ef95fc9 P 36236dd5bd604ba2819038e525a3790c: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-1/wal/wals/753328bb98be4189abdbf6d60ef95fc9
I20260620 14:48:07.098213 10091 ts_tablet_manager.cc:1939] T 753328bb98be4189abdbf6d60ef95fc9 P 36236dd5bd604ba2819038e525a3790c: Deleting consensus metadata
I20260620 14:48:07.098217 10098 ts_tablet_manager.cc:1939] T 309a0915648643ada08981a11e7a1e59 P 6c99207e35f8463292d71c371c9546b4: Deleting consensus metadata
I20260620 14:48:07.099833 10089 tablet_bootstrap.cc:492] T 17c70368ee9e4328bd780654572e1905 P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:48:07.099959 10089 ts_tablet_manager.cc:1397] T 17c70368ee9e4328bd780654572e1905 P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260620 14:48:07.100713 10089 raft_consensus.cc:348] T 17c70368ee9e4328bd780654572e1905 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.100980 10089 raft_consensus.cc:374] T 17c70368ee9e4328bd780654572e1905 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:48:07.101066 10089 raft_consensus.cc:729] T 17c70368ee9e4328bd780654572e1905 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:48:07.101315 10089 consensus_queue.cc:260] T 17c70368ee9e4328bd780654572e1905 P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.101840 10089 ts_tablet_manager.cc:1428] T 17c70368ee9e4328bd780654572e1905 P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 14:48:07.102111 10089 tablet_bootstrap.cc:492] T a8aa5397f7914b83a1d94bd14455f98d P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:48:07.103137 10092 ts_tablet_manager.cc:1918] T 1ad679f398ab41a1bc207b016648cbe8 P c0e6c57ab91e42bf9be3739c816916c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:48:07.103241 10092 log.cc:1196] T 1ad679f398ab41a1bc207b016648cbe8 P c0e6c57ab91e42bf9be3739c816916c0: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-0/wal/wals/1ad679f398ab41a1bc207b016648cbe8
I20260620 14:48:07.103653 10092 ts_tablet_manager.cc:1939] T 1ad679f398ab41a1bc207b016648cbe8 P c0e6c57ab91e42bf9be3739c816916c0: Deleting consensus metadata
I20260620 14:48:07.103761 10089 tablet_bootstrap.cc:654] T a8aa5397f7914b83a1d94bd14455f98d P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:48:07.105304 10098 tablet_replica.cc:330] T 1ad679f398ab41a1bc207b016648cbe8 P 6c99207e35f8463292d71c371c9546b4: stopping tablet replica
I20260620 14:48:07.105504 10098 raft_consensus.cc:2229] T 1ad679f398ab41a1bc207b016648cbe8 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 14:48:07.105703 10098 raft_consensus.cc:2258] T 1ad679f398ab41a1bc207b016648cbe8 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:48:07.106279 10098 ts_tablet_manager.cc:1905] T 1ad679f398ab41a1bc207b016648cbe8 P 6c99207e35f8463292d71c371c9546b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:48:07.109419 10096 raft_consensus.cc:482] T e29636c50e7f49a9b086c475b2b8cc2f P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:07.109593 10096 raft_consensus.cc:504] T e29636c50e7f49a9b086c475b2b8cc2f P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.110296 10096 leader_election.cc:288] T e29636c50e7f49a9b086c475b2b8cc2f P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:48:07.111094 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e29636c50e7f49a9b086c475b2b8cc2f" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:48:07.111340 8659 raft_consensus.cc:2454] T e29636c50e7f49a9b086c475b2b8cc2f P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 0.
I20260620 14:48:07.111269 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e29636c50e7f49a9b086c475b2b8cc2f" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4" is_pre_election: true
I20260620 14:48:07.111824 8733 leader_election.cc:302] T e29636c50e7f49a9b086c475b2b8cc2f P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:48:07.112244 10094 tablet_bootstrap.cc:492] T 31e1bc87e526443e93e1f7d9b79659a7 P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
W20260620 14:48:07.112250 8733 leader_election.cc:341] T e29636c50e7f49a9b086c475b2b8cc2f P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260620 14:48:07.112417 10094 ts_tablet_manager.cc:1397] T 31e1bc87e526443e93e1f7d9b79659a7 P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.004s
I20260620 14:48:07.112550 10096 raft_consensus.cc:2781] T e29636c50e7f49a9b086c475b2b8cc2f P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:48:07.112650 10096 raft_consensus.cc:482] T e29636c50e7f49a9b086c475b2b8cc2f P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:48:07.112735 10096 raft_consensus.cc:3037] T e29636c50e7f49a9b086c475b2b8cc2f P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:48:07.113250 10094 raft_consensus.cc:348] T 31e1bc87e526443e93e1f7d9b79659a7 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.113467 10094 raft_consensus.cc:374] T 31e1bc87e526443e93e1f7d9b79659a7 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:48:07.113529 10094 raft_consensus.cc:729] T 31e1bc87e526443e93e1f7d9b79659a7 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:48:07.113740 10094 consensus_queue.cc:260] T 31e1bc87e526443e93e1f7d9b79659a7 P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.114252 10094 ts_tablet_manager.cc:1428] T 31e1bc87e526443e93e1f7d9b79659a7 P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260620 14:48:07.114528 10094 tablet_bootstrap.cc:492] T 1c7ec92b27c444b2bc03a1993959de26 P c0e6c57ab91e42bf9be3739c816916c0: Bootstrap starting.
I20260620 14:48:07.116111 10094 tablet_bootstrap.cc:654] T 1c7ec92b27c444b2bc03a1993959de26 P c0e6c57ab91e42bf9be3739c816916c0: Neither blocks nor log segments found. Creating new log.
I20260620 14:48:07.119405 10100 tablet_bootstrap.cc:492] T a8aa5397f7914b83a1d94bd14455f98d P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:48:07.119539 10100 ts_tablet_manager.cc:1397] T a8aa5397f7914b83a1d94bd14455f98d P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.068s user 0.003s sys 0.006s
I20260620 14:48:07.120394 10100 raft_consensus.cc:348] T a8aa5397f7914b83a1d94bd14455f98d P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.120673 10100 raft_consensus.cc:374] T a8aa5397f7914b83a1d94bd14455f98d P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:48:07.120782 10100 raft_consensus.cc:729] T a8aa5397f7914b83a1d94bd14455f98d P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:48:07.121026 10100 consensus_queue.cc:260] T a8aa5397f7914b83a1d94bd14455f98d P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.123095 10100 ts_tablet_manager.cc:1428] T a8aa5397f7914b83a1d94bd14455f98d P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260620 14:48:07.124229 10100 tablet_bootstrap.cc:492] T 31e1bc87e526443e93e1f7d9b79659a7 P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:48:07.125957 10100 tablet_bootstrap.cc:654] T 31e1bc87e526443e93e1f7d9b79659a7 P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:48:07.127262 10096 raft_consensus.cc:504] T e29636c50e7f49a9b086c475b2b8cc2f P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.128463 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e29636c50e7f49a9b086c475b2b8cc2f" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4"
W20260620 14:48:07.129098 8733 leader_election.cc:341] T e29636c50e7f49a9b086c475b2b8cc2f P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Illegal state: must be running to vote when last-logged opid is not known
I20260620 14:48:07.129855 10096 leader_election.cc:288] T e29636c50e7f49a9b086c475b2b8cc2f P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 election: Requested vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:48:07.129940 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e29636c50e7f49a9b086c475b2b8cc2f" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:48:07.130160 8659 raft_consensus.cc:3037] T e29636c50e7f49a9b086c475b2b8cc2f P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:48:07.130995 10094 tablet_bootstrap.cc:492] T 1c7ec92b27c444b2bc03a1993959de26 P c0e6c57ab91e42bf9be3739c816916c0: No bootstrap required, opened a new log
I20260620 14:48:07.131141 10094 ts_tablet_manager.cc:1397] T 1c7ec92b27c444b2bc03a1993959de26 P c0e6c57ab91e42bf9be3739c816916c0: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.003s
I20260620 14:48:07.131980 10094 raft_consensus.cc:348] T 1c7ec92b27c444b2bc03a1993959de26 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.132202 10094 raft_consensus.cc:374] T 1c7ec92b27c444b2bc03a1993959de26 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:48:07.132300 10094 raft_consensus.cc:729] T 1c7ec92b27c444b2bc03a1993959de26 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Initialized, Role: FOLLOWER
I20260620 14:48:07.132561 10094 consensus_queue.cc:260] T 1c7ec92b27c444b2bc03a1993959de26 P c0e6c57ab91e42bf9be3739c816916c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.133126 10094 ts_tablet_manager.cc:1428] T 1c7ec92b27c444b2bc03a1993959de26 P c0e6c57ab91e42bf9be3739c816916c0: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260620 14:48:07.133468 8659 raft_consensus.cc:2454] T e29636c50e7f49a9b086c475b2b8cc2f P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 1.
I20260620 14:48:07.134245 8733 leader_election.cc:302] T e29636c50e7f49a9b086c475b2b8cc2f P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, c0e6c57ab91e42bf9be3739c816916c0; no voters: 6c99207e35f8463292d71c371c9546b4
I20260620 14:48:07.134425 10089 tablet_bootstrap.cc:492] T a8aa5397f7914b83a1d94bd14455f98d P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:48:07.134637 10089 ts_tablet_manager.cc:1397] T a8aa5397f7914b83a1d94bd14455f98d P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.033s user 0.006s sys 0.003s
I20260620 14:48:07.135479 10089 raft_consensus.cc:348] T a8aa5397f7914b83a1d94bd14455f98d P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.135798 10089 raft_consensus.cc:374] T a8aa5397f7914b83a1d94bd14455f98d P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:48:07.135905 10089 raft_consensus.cc:729] T a8aa5397f7914b83a1d94bd14455f98d P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:48:07.135978 10096 raft_consensus.cc:2781] T e29636c50e7f49a9b086c475b2b8cc2f P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:48:07.136174 10089 consensus_queue.cc:260] T a8aa5397f7914b83a1d94bd14455f98d P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.136368 10096 raft_consensus.cc:686] T e29636c50e7f49a9b086c475b2b8cc2f P 36236dd5bd604ba2819038e525a3790c [term 1 LEADER]: Becoming Leader. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Running, Role: LEADER
I20260620 14:48:07.136814 10089 ts_tablet_manager.cc:1428] T a8aa5397f7914b83a1d94bd14455f98d P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 14:48:07.136632 10096 consensus_queue.cc:237] T e29636c50e7f49a9b086c475b2b8cc2f P 36236dd5bd604ba2819038e525a3790c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.137322 10089 tablet_bootstrap.cc:492] T 1c7ec92b27c444b2bc03a1993959de26 P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:48:07.139307 10089 tablet_bootstrap.cc:654] T 1c7ec92b27c444b2bc03a1993959de26 P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:48:07.140005 10098 ts_tablet_manager.cc:1918] T 1ad679f398ab41a1bc207b016648cbe8 P 6c99207e35f8463292d71c371c9546b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260620 14:48:07.140172 10098 log.cc:1196] T 1ad679f398ab41a1bc207b016648cbe8 P 6c99207e35f8463292d71c371c9546b4: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal/wals/1ad679f398ab41a1bc207b016648cbe8
I20260620 14:48:07.140527 10098 ts_tablet_manager.cc:1939] T 1ad679f398ab41a1bc207b016648cbe8 P 6c99207e35f8463292d71c371c9546b4: Deleting consensus metadata
I20260620 14:48:07.141604 10098 tablet_replica.cc:330] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4: stopping tablet replica
I20260620 14:48:07.141803 10098 raft_consensus.cc:2229] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Raft consensus shutting down.
I20260620 14:48:07.142140 10098 raft_consensus.cc:2258] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 14:48:07.142673 10098 ts_tablet_manager.cc:1905] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260620 14:48:07.147226 10100 tablet_bootstrap.cc:492] T 31e1bc87e526443e93e1f7d9b79659a7 P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:48:07.147450 10089 tablet_bootstrap.cc:492] T 1c7ec92b27c444b2bc03a1993959de26 P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:48:07.147478 10100 ts_tablet_manager.cc:1397] T 31e1bc87e526443e93e1f7d9b79659a7 P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.003s
I20260620 14:48:07.147608 10089 ts_tablet_manager.cc:1397] T 1c7ec92b27c444b2bc03a1993959de26 P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260620 14:48:07.148373 10089 raft_consensus.cc:348] T 1c7ec92b27c444b2bc03a1993959de26 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.148612 10089 raft_consensus.cc:374] T 1c7ec92b27c444b2bc03a1993959de26 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:48:07.148710 10089 raft_consensus.cc:729] T 1c7ec92b27c444b2bc03a1993959de26 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:48:07.148952 10089 consensus_queue.cc:260] T 1c7ec92b27c444b2bc03a1993959de26 P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.149585 10089 ts_tablet_manager.cc:1428] T 1c7ec92b27c444b2bc03a1993959de26 P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 14:48:07.149886 10089 tablet_bootstrap.cc:492] T 76cc8408ccc842ecac157fbc92540f2d P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:48:07.149763 10100 raft_consensus.cc:348] T 31e1bc87e526443e93e1f7d9b79659a7 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.149986 10100 raft_consensus.cc:374] T 31e1bc87e526443e93e1f7d9b79659a7 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:48:07.150053 10100 raft_consensus.cc:729] T 31e1bc87e526443e93e1f7d9b79659a7 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:48:07.150264 10100 consensus_queue.cc:260] T 31e1bc87e526443e93e1f7d9b79659a7 P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.150782 10100 ts_tablet_manager.cc:1428] T 31e1bc87e526443e93e1f7d9b79659a7 P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 14:48:07.151088 10100 tablet_bootstrap.cc:492] T 76cc8408ccc842ecac157fbc92540f2d P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:48:07.148922 10098 ts_tablet_manager.cc:1918] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260620 14:48:07.151633 10098 log.cc:1196] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4: Deleting WAL directory at /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/ts-2/wal/wals/753328bb98be4189abdbf6d60ef95fc9
I20260620 14:48:07.152096 10098 ts_tablet_manager.cc:1939] T 753328bb98be4189abdbf6d60ef95fc9 P 6c99207e35f8463292d71c371c9546b4: Deleting consensus metadata
I20260620 14:48:07.152669 10089 tablet_bootstrap.cc:654] T 76cc8408ccc842ecac157fbc92540f2d P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:48:07.155086 10100 tablet_bootstrap.cc:654] T 76cc8408ccc842ecac157fbc92540f2d P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:48:07.157153 10100 tablet_bootstrap.cc:492] T 76cc8408ccc842ecac157fbc92540f2d P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:48:07.157302 10100 ts_tablet_manager.cc:1397] T 76cc8408ccc842ecac157fbc92540f2d P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20260620 14:48:07.158017 10100 raft_consensus.cc:348] T 76cc8408ccc842ecac157fbc92540f2d P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.158373 10100 raft_consensus.cc:374] T 76cc8408ccc842ecac157fbc92540f2d P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:48:07.158509 10100 raft_consensus.cc:729] T 76cc8408ccc842ecac157fbc92540f2d P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:48:07.158789 10100 consensus_queue.cc:260] T 76cc8408ccc842ecac157fbc92540f2d P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.159384 10100 ts_tablet_manager.cc:1428] T 76cc8408ccc842ecac157fbc92540f2d P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 14:48:07.159703 10100 tablet_bootstrap.cc:492] T 1c7ec92b27c444b2bc03a1993959de26 P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:48:07.160531 10089 tablet_bootstrap.cc:492] T 76cc8408ccc842ecac157fbc92540f2d P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:48:07.160696 10089 ts_tablet_manager.cc:1397] T 76cc8408ccc842ecac157fbc92540f2d P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.002s
I20260620 14:48:07.161339 10100 tablet_bootstrap.cc:654] T 1c7ec92b27c444b2bc03a1993959de26 P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:48:07.161499 10089 raft_consensus.cc:348] T 76cc8408ccc842ecac157fbc92540f2d P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.161751 10089 raft_consensus.cc:374] T 76cc8408ccc842ecac157fbc92540f2d P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:48:07.161832 10089 raft_consensus.cc:729] T 76cc8408ccc842ecac157fbc92540f2d P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:48:07.162058 10089 consensus_queue.cc:260] T 76cc8408ccc842ecac157fbc92540f2d P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.164785 10089 ts_tablet_manager.cc:1428] T 76cc8408ccc842ecac157fbc92540f2d P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260620 14:48:07.166045 10089 tablet_bootstrap.cc:492] T 776892be9b4b49b58d9812970e51d1e5 P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:48:07.166997 10100 tablet_bootstrap.cc:492] T 1c7ec92b27c444b2bc03a1993959de26 P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:48:07.167163 10100 ts_tablet_manager.cc:1397] T 1c7ec92b27c444b2bc03a1993959de26 P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260620 14:48:07.167804 10089 tablet_bootstrap.cc:654] T 776892be9b4b49b58d9812970e51d1e5 P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:48:07.167814 10100 raft_consensus.cc:348] T 1c7ec92b27c444b2bc03a1993959de26 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.168090 10100 raft_consensus.cc:374] T 1c7ec92b27c444b2bc03a1993959de26 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:48:07.168179 10100 raft_consensus.cc:729] T 1c7ec92b27c444b2bc03a1993959de26 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:48:07.168406 10100 consensus_queue.cc:260] T 1c7ec92b27c444b2bc03a1993959de26 P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.168953 10100 ts_tablet_manager.cc:1428] T 1c7ec92b27c444b2bc03a1993959de26 P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260620 14:48:07.170565 10089 tablet_bootstrap.cc:492] T 776892be9b4b49b58d9812970e51d1e5 P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:48:07.171238 10100 tablet_bootstrap.cc:492] T 7fe9685389a04338a0c2ff23cac957d3 P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:48:07.170707 10089 ts_tablet_manager.cc:1397] T 776892be9b4b49b58d9812970e51d1e5 P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260620 14:48:07.172210 10089 raft_consensus.cc:348] T 776892be9b4b49b58d9812970e51d1e5 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.172448 10089 raft_consensus.cc:374] T 776892be9b4b49b58d9812970e51d1e5 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:48:07.172535 10089 raft_consensus.cc:729] T 776892be9b4b49b58d9812970e51d1e5 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:48:07.173012 10089 consensus_queue.cc:260] T 776892be9b4b49b58d9812970e51d1e5 P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.173486 10100 tablet_bootstrap.cc:654] T 7fe9685389a04338a0c2ff23cac957d3 P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:48:07.174507 10089 ts_tablet_manager.cc:1428] T 776892be9b4b49b58d9812970e51d1e5 P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260620 14:48:07.175608 10089 tablet_bootstrap.cc:492] T 7fe9685389a04338a0c2ff23cac957d3 P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:48:07.177350 10089 tablet_bootstrap.cc:654] T 7fe9685389a04338a0c2ff23cac957d3 P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:48:07.182868 10100 tablet_bootstrap.cc:492] T 7fe9685389a04338a0c2ff23cac957d3 P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:48:07.183046 10100 ts_tablet_manager.cc:1397] T 7fe9685389a04338a0c2ff23cac957d3 P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.007s
I20260620 14:48:07.183276 10089 tablet_bootstrap.cc:492] T 7fe9685389a04338a0c2ff23cac957d3 P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:48:07.183473 10089 ts_tablet_manager.cc:1397] T 7fe9685389a04338a0c2ff23cac957d3 P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.001s
I20260620 14:48:07.183822 10100 raft_consensus.cc:348] T 7fe9685389a04338a0c2ff23cac957d3 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.184023 10100 raft_consensus.cc:374] T 7fe9685389a04338a0c2ff23cac957d3 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:48:07.184144 10100 raft_consensus.cc:729] T 7fe9685389a04338a0c2ff23cac957d3 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:48:07.184208 10089 raft_consensus.cc:348] T 7fe9685389a04338a0c2ff23cac957d3 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.184458 10089 raft_consensus.cc:374] T 7fe9685389a04338a0c2ff23cac957d3 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:48:07.184540 10089 raft_consensus.cc:729] T 7fe9685389a04338a0c2ff23cac957d3 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:48:07.184403 10100 consensus_queue.cc:260] T 7fe9685389a04338a0c2ff23cac957d3 P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.184847 10089 consensus_queue.cc:260] T 7fe9685389a04338a0c2ff23cac957d3 P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.185038 10100 ts_tablet_manager.cc:1428] T 7fe9685389a04338a0c2ff23cac957d3 P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260620 14:48:07.186473 10089 ts_tablet_manager.cc:1428] T 7fe9685389a04338a0c2ff23cac957d3 P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260620 14:48:07.186821 10100 tablet_bootstrap.cc:492] T e29636c50e7f49a9b086c475b2b8cc2f P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:48:07.187556 10089 tablet_bootstrap.cc:492] T 16ecb528da2746fda47d12a11af8b774 P 36236dd5bd604ba2819038e525a3790c: Bootstrap starting.
I20260620 14:48:07.189178 10089 tablet_bootstrap.cc:654] T 16ecb528da2746fda47d12a11af8b774 P 36236dd5bd604ba2819038e525a3790c: Neither blocks nor log segments found. Creating new log.
I20260620 14:48:07.191056 10100 tablet_bootstrap.cc:654] T e29636c50e7f49a9b086c475b2b8cc2f P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:48:07.191500 10089 tablet_bootstrap.cc:492] T 16ecb528da2746fda47d12a11af8b774 P 36236dd5bd604ba2819038e525a3790c: No bootstrap required, opened a new log
I20260620 14:48:07.191636 10089 ts_tablet_manager.cc:1397] T 16ecb528da2746fda47d12a11af8b774 P 36236dd5bd604ba2819038e525a3790c: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260620 14:48:07.192406 10089 raft_consensus.cc:348] T 16ecb528da2746fda47d12a11af8b774 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.192618 10089 raft_consensus.cc:374] T 16ecb528da2746fda47d12a11af8b774 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:48:07.192699 10100 tablet_bootstrap.cc:492] T e29636c50e7f49a9b086c475b2b8cc2f P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:48:07.192713 10089 raft_consensus.cc:729] T 16ecb528da2746fda47d12a11af8b774 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Initialized, Role: FOLLOWER
I20260620 14:48:07.192879 10100 ts_tablet_manager.cc:1397] T e29636c50e7f49a9b086c475b2b8cc2f P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.001s
I20260620 14:48:07.192962 10089 consensus_queue.cc:260] T 16ecb528da2746fda47d12a11af8b774 P 36236dd5bd604ba2819038e525a3790c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.193580 10100 raft_consensus.cc:348] T e29636c50e7f49a9b086c475b2b8cc2f P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.193817 10100 raft_consensus.cc:374] T e29636c50e7f49a9b086c475b2b8cc2f P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:48:07.193886 10100 raft_consensus.cc:729] T e29636c50e7f49a9b086c475b2b8cc2f P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:48:07.194356 10100 consensus_queue.cc:260] T e29636c50e7f49a9b086c475b2b8cc2f P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.194547 10089 ts_tablet_manager.cc:1428] T 16ecb528da2746fda47d12a11af8b774 P 36236dd5bd604ba2819038e525a3790c: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260620 14:48:07.194893 10100 ts_tablet_manager.cc:1428] T e29636c50e7f49a9b086c475b2b8cc2f P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260620 14:48:07.195298 10100 tablet_bootstrap.cc:492] T 17c70368ee9e4328bd780654572e1905 P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:48:07.197207 10100 tablet_bootstrap.cc:654] T 17c70368ee9e4328bd780654572e1905 P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:48:07.201787 10100 tablet_bootstrap.cc:492] T 17c70368ee9e4328bd780654572e1905 P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:48:07.201942 10100 ts_tablet_manager.cc:1397] T 17c70368ee9e4328bd780654572e1905 P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.003s
I20260620 14:48:07.202575 10100 raft_consensus.cc:348] T 17c70368ee9e4328bd780654572e1905 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.202736 10100 raft_consensus.cc:374] T 17c70368ee9e4328bd780654572e1905 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:48:07.202843 10100 raft_consensus.cc:729] T 17c70368ee9e4328bd780654572e1905 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:48:07.203060 10100 consensus_queue.cc:260] T 17c70368ee9e4328bd780654572e1905 P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.203624 10100 ts_tablet_manager.cc:1428] T 17c70368ee9e4328bd780654572e1905 P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 14:48:07.203922 10100 tablet_bootstrap.cc:492] T 16ecb528da2746fda47d12a11af8b774 P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:48:07.206727 10100 tablet_bootstrap.cc:654] T 16ecb528da2746fda47d12a11af8b774 P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:48:07.208684 10100 tablet_bootstrap.cc:492] T 16ecb528da2746fda47d12a11af8b774 P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:48:07.208876 10100 ts_tablet_manager.cc:1397] T 16ecb528da2746fda47d12a11af8b774 P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260620 14:48:07.209481 10100 raft_consensus.cc:348] T 16ecb528da2746fda47d12a11af8b774 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.209648 10100 raft_consensus.cc:374] T 16ecb528da2746fda47d12a11af8b774 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:48:07.209743 10100 raft_consensus.cc:729] T 16ecb528da2746fda47d12a11af8b774 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:48:07.209956 10100 consensus_queue.cc:260] T 16ecb528da2746fda47d12a11af8b774 P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.210484 10100 ts_tablet_manager.cc:1428] T 16ecb528da2746fda47d12a11af8b774 P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260620 14:48:07.210836 10100 tablet_bootstrap.cc:492] T 776892be9b4b49b58d9812970e51d1e5 P 6c99207e35f8463292d71c371c9546b4: Bootstrap starting.
I20260620 14:48:07.212541 10100 tablet_bootstrap.cc:654] T 776892be9b4b49b58d9812970e51d1e5 P 6c99207e35f8463292d71c371c9546b4: Neither blocks nor log segments found. Creating new log.
I20260620 14:48:07.214532 10100 tablet_bootstrap.cc:492] T 776892be9b4b49b58d9812970e51d1e5 P 6c99207e35f8463292d71c371c9546b4: No bootstrap required, opened a new log
I20260620 14:48:07.214679 10100 ts_tablet_manager.cc:1397] T 776892be9b4b49b58d9812970e51d1e5 P 6c99207e35f8463292d71c371c9546b4: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260620 14:48:07.215423 10100 raft_consensus.cc:348] T 776892be9b4b49b58d9812970e51d1e5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.215636 10100 raft_consensus.cc:374] T 776892be9b4b49b58d9812970e51d1e5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 14:48:07.215746 10100 raft_consensus.cc:729] T 776892be9b4b49b58d9812970e51d1e5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Initialized, Role: FOLLOWER
I20260620 14:48:07.215974 10100 consensus_queue.cc:260] T 776892be9b4b49b58d9812970e51d1e5 P 6c99207e35f8463292d71c371c9546b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.216483 10100 ts_tablet_manager.cc:1428] T 776892be9b4b49b58d9812970e51d1e5 P 6c99207e35f8463292d71c371c9546b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260620 14:48:07.274655 8869 connection.cc:535] server connection from 127.0.0.1:36850 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 14:48:07.274719 8597 connection.cc:535] server connection from 127.0.0.1:53894 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 14:48:07.274849 8868 connection.cc:535] client connection to 127.7.222.254:39515 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 14:48:07.275012 8732 connection.cc:535] server connection from 127.0.0.1:38918 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 14:48:07.275244 8732 connection.cc:535] client connection to 127.7.222.254:39515 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 14:48:07.275475 8595 connection.cc:535] client connection to 127.7.222.254:39515 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 14:48:07.275977 8987 connection.cc:535] client connection to 127.7.222.254:39515 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 14:48:07.277107 8987 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.7.222.254:39515)
W20260620 14:48:07.277629 8987 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.7.222.254:39515)
W20260620 14:48:07.277859 8987 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.7.222.254:39515)
W20260620 14:48:07.278143 8987 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.7.222.254:39515)
I20260620 14:48:07.303977 10123 raft_consensus.cc:482] T 16ecb528da2746fda47d12a11af8b774 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:07.304147 10123 raft_consensus.cc:504] T 16ecb528da2746fda47d12a11af8b774 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.305042 10123 leader_election.cc:288] T 16ecb528da2746fda47d12a11af8b774 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:48:07.305507 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16ecb528da2746fda47d12a11af8b774" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:48:07.305608 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16ecb528da2746fda47d12a11af8b774" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:48:07.305751 8799 raft_consensus.cc:2454] T 16ecb528da2746fda47d12a11af8b774 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:48:07.305881 8659 raft_consensus.cc:2454] T 16ecb528da2746fda47d12a11af8b774 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:48:07.306260 8871 leader_election.cc:302] T 16ecb528da2746fda47d12a11af8b774 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4; no voters:
I20260620 14:48:07.306576 10123 raft_consensus.cc:2781] T 16ecb528da2746fda47d12a11af8b774 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:48:07.306700 10123 raft_consensus.cc:482] T 16ecb528da2746fda47d12a11af8b774 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:48:07.306787 10123 raft_consensus.cc:3037] T 16ecb528da2746fda47d12a11af8b774 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:48:07.308626 10123 raft_consensus.cc:504] T 16ecb528da2746fda47d12a11af8b774 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.309122 10123 leader_election.cc:288] T 16ecb528da2746fda47d12a11af8b774 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Requested vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:48:07.309624 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16ecb528da2746fda47d12a11af8b774" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:48:07.309600 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16ecb528da2746fda47d12a11af8b774" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:48:07.309829 8799 raft_consensus.cc:3037] T 16ecb528da2746fda47d12a11af8b774 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:48:07.309861 8659 raft_consensus.cc:3037] T 16ecb528da2746fda47d12a11af8b774 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:48:07.312585 8659 raft_consensus.cc:2454] T 16ecb528da2746fda47d12a11af8b774 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:48:07.312601 8799 raft_consensus.cc:2454] T 16ecb528da2746fda47d12a11af8b774 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:48:07.313297 8871 leader_election.cc:302] T 16ecb528da2746fda47d12a11af8b774 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4; no voters:
I20260620 14:48:07.314513 10123 raft_consensus.cc:2781] T 16ecb528da2746fda47d12a11af8b774 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election won for term 1
W20260620 14:48:07.314710 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 6: this message will repeat every 5th retry.
I20260620 14:48:07.314689 10123 raft_consensus.cc:686] T 16ecb528da2746fda47d12a11af8b774 P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Becoming Leader. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Running, Role: LEADER
I20260620 14:48:07.315136 10123 consensus_queue.cc:237] T 16ecb528da2746fda47d12a11af8b774 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.318655 10123 raft_consensus.cc:482] T a8aa5397f7914b83a1d94bd14455f98d P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:07.318799 10123 raft_consensus.cc:504] T a8aa5397f7914b83a1d94bd14455f98d P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.319275 10123 leader_election.cc:288] T a8aa5397f7914b83a1d94bd14455f98d P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:48:07.319603 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8aa5397f7914b83a1d94bd14455f98d" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:48:07.319725 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8aa5397f7914b83a1d94bd14455f98d" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:48:07.319855 8799 raft_consensus.cc:2454] T a8aa5397f7914b83a1d94bd14455f98d P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:48:07.320215 8871 leader_election.cc:302] T a8aa5397f7914b83a1d94bd14455f98d P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4; no voters:
I20260620 14:48:07.320492 10123 raft_consensus.cc:2781] T a8aa5397f7914b83a1d94bd14455f98d P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:48:07.320588 10123 raft_consensus.cc:482] T a8aa5397f7914b83a1d94bd14455f98d P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:48:07.320698 10123 raft_consensus.cc:3037] T a8aa5397f7914b83a1d94bd14455f98d P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:48:07.321023 8659 raft_consensus.cc:2454] T a8aa5397f7914b83a1d94bd14455f98d P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:48:07.322865 10123 raft_consensus.cc:504] T a8aa5397f7914b83a1d94bd14455f98d P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.323390 10123 leader_election.cc:288] T a8aa5397f7914b83a1d94bd14455f98d P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Requested vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:48:07.323717 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8aa5397f7914b83a1d94bd14455f98d" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:48:07.323833 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8aa5397f7914b83a1d94bd14455f98d" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:48:07.323985 8799 raft_consensus.cc:3037] T a8aa5397f7914b83a1d94bd14455f98d P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:48:07.324002 8659 raft_consensus.cc:3037] T a8aa5397f7914b83a1d94bd14455f98d P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:48:07.326766 8659 raft_consensus.cc:2454] T a8aa5397f7914b83a1d94bd14455f98d P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:48:07.326749 8799 raft_consensus.cc:2454] T a8aa5397f7914b83a1d94bd14455f98d P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:48:07.327137 8871 leader_election.cc:302] T a8aa5397f7914b83a1d94bd14455f98d P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4; no voters:
I20260620 14:48:07.327378 10123 raft_consensus.cc:2781] T a8aa5397f7914b83a1d94bd14455f98d P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:48:07.327548 10123 raft_consensus.cc:686] T a8aa5397f7914b83a1d94bd14455f98d P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Becoming Leader. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Running, Role: LEADER
I20260620 14:48:07.327793 10123 consensus_queue.cc:237] T a8aa5397f7914b83a1d94bd14455f98d P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.359946 10123 raft_consensus.cc:482] T 76cc8408ccc842ecac157fbc92540f2d P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:07.360172 10123 raft_consensus.cc:504] T 76cc8408ccc842ecac157fbc92540f2d P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.360831 10123 leader_election.cc:288] T 76cc8408ccc842ecac157fbc92540f2d P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:48:07.361354 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76cc8408ccc842ecac157fbc92540f2d" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:48:07.361402 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76cc8408ccc842ecac157fbc92540f2d" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:48:07.361650 8659 raft_consensus.cc:2454] T 76cc8408ccc842ecac157fbc92540f2d P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:48:07.361625 8799 raft_consensus.cc:2454] T 76cc8408ccc842ecac157fbc92540f2d P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:48:07.362102 8871 leader_election.cc:302] T 76cc8408ccc842ecac157fbc92540f2d P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4; no voters:
I20260620 14:48:07.362414 10123 raft_consensus.cc:2781] T 76cc8408ccc842ecac157fbc92540f2d P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:48:07.362576 10123 raft_consensus.cc:482] T 76cc8408ccc842ecac157fbc92540f2d P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:48:07.362742 10123 raft_consensus.cc:3037] T 76cc8408ccc842ecac157fbc92540f2d P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:48:07.364836 10123 raft_consensus.cc:504] T 76cc8408ccc842ecac157fbc92540f2d P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.365409 10123 leader_election.cc:288] T 76cc8408ccc842ecac157fbc92540f2d P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Requested vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:48:07.365869 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76cc8408ccc842ecac157fbc92540f2d" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:48:07.365865 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76cc8408ccc842ecac157fbc92540f2d" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:48:07.366075 8799 raft_consensus.cc:3037] T 76cc8408ccc842ecac157fbc92540f2d P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:48:07.366098 8659 raft_consensus.cc:3037] T 76cc8408ccc842ecac157fbc92540f2d P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:48:07.368935 8659 raft_consensus.cc:2454] T 76cc8408ccc842ecac157fbc92540f2d P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:48:07.368947 8799 raft_consensus.cc:2454] T 76cc8408ccc842ecac157fbc92540f2d P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:48:07.369369 8869 leader_election.cc:302] T 76cc8408ccc842ecac157fbc92540f2d P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:48:07.369668 10123 raft_consensus.cc:2781] T 76cc8408ccc842ecac157fbc92540f2d P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:48:07.369835 10123 raft_consensus.cc:686] T 76cc8408ccc842ecac157fbc92540f2d P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Becoming Leader. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Running, Role: LEADER
I20260620 14:48:07.370327 10123 consensus_queue.cc:237] T 76cc8408ccc842ecac157fbc92540f2d P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.384012 10140 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dd308569015348a7a19ba4a560de6d52)
I20260620 14:48:07.384241 10140 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:07.384961 10140 leader_election.cc:288] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209)
W20260620 14:48:07.386929 9979 leader_election.cc:334] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:48:07.387168 9981 leader_election.cc:334] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209): Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
I20260620 14:48:07.387308 9981 leader_election.cc:302] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61512e6d316d4d3a998e52511a0bba7a; no voters: caa9dcf251944f7d97f4ed7f3d83af44, dd308569015348a7a19ba4a560de6d52
I20260620 14:48:07.387554 10140 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 14:48:07.427284 10123 raft_consensus.cc:482] T e29636c50e7f49a9b086c475b2b8cc2f P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:07.427551 10123 raft_consensus.cc:504] T e29636c50e7f49a9b086c475b2b8cc2f P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.429059 10123 leader_election.cc:288] T e29636c50e7f49a9b086c475b2b8cc2f P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:48:07.429538 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e29636c50e7f49a9b086c475b2b8cc2f" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:48:07.429684 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e29636c50e7f49a9b086c475b2b8cc2f" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:48:07.430007 8659 raft_consensus.cc:2379] T e29636c50e7f49a9b086c475b2b8cc2f P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c99207e35f8463292d71c371c9546b4 in current term 1: Already voted for candidate 36236dd5bd604ba2819038e525a3790c in this term.
I20260620 14:48:07.430369 8869 leader_election.cc:302] T e29636c50e7f49a9b086c475b2b8cc2f P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4; no voters: 36236dd5bd604ba2819038e525a3790c, c0e6c57ab91e42bf9be3739c816916c0
I20260620 14:48:07.430642 10123 raft_consensus.cc:3037] T e29636c50e7f49a9b086c475b2b8cc2f P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:48:07.432587 10123 raft_consensus.cc:2726] T e29636c50e7f49a9b086c475b2b8cc2f P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260620 14:48:07.503930 9977 raft_consensus.cc:482] T 17c70368ee9e4328bd780654572e1905 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:07.504161 9977 raft_consensus.cc:504] T 17c70368ee9e4328bd780654572e1905 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.504899 9977 leader_election.cc:288] T 17c70368ee9e4328bd780654572e1905 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:48:07.505446 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17c70368ee9e4328bd780654572e1905" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:48:07.505671 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17c70368ee9e4328bd780654572e1905" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4" is_pre_election: true
I20260620 14:48:07.505753 8799 raft_consensus.cc:2454] T 17c70368ee9e4328bd780654572e1905 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 0.
I20260620 14:48:07.505913 8935 raft_consensus.cc:2454] T 17c70368ee9e4328bd780654572e1905 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 0.
I20260620 14:48:07.506242 8598 leader_election.cc:302] T 17c70368ee9e4328bd780654572e1905 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:48:07.506518 9977 raft_consensus.cc:2781] T 17c70368ee9e4328bd780654572e1905 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:48:07.506618 9977 raft_consensus.cc:482] T 17c70368ee9e4328bd780654572e1905 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:48:07.506685 9977 raft_consensus.cc:3037] T 17c70368ee9e4328bd780654572e1905 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:48:07.508740 9977 raft_consensus.cc:504] T 17c70368ee9e4328bd780654572e1905 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.509440 9977 leader_election.cc:288] T 17c70368ee9e4328bd780654572e1905 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 election: Requested vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:48:07.509768 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17c70368ee9e4328bd780654572e1905" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:48:07.509876 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17c70368ee9e4328bd780654572e1905" candidate_uuid: "c0e6c57ab91e42bf9be3739c816916c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4"
I20260620 14:48:07.509970 8799 raft_consensus.cc:3037] T 17c70368ee9e4328bd780654572e1905 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:48:07.510107 8935 raft_consensus.cc:3037] T 17c70368ee9e4328bd780654572e1905 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:48:07.511832 8799 raft_consensus.cc:2454] T 17c70368ee9e4328bd780654572e1905 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 1.
I20260620 14:48:07.511904 8935 raft_consensus.cc:2454] T 17c70368ee9e4328bd780654572e1905 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0e6c57ab91e42bf9be3739c816916c0 in term 1.
I20260620 14:48:07.512226 8598 leader_election.cc:302] T 17c70368ee9e4328bd780654572e1905 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:48:07.512526 9977 raft_consensus.cc:2781] T 17c70368ee9e4328bd780654572e1905 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:48:07.512681 9977 raft_consensus.cc:686] T 17c70368ee9e4328bd780654572e1905 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 LEADER]: Becoming Leader. State: Replica: c0e6c57ab91e42bf9be3739c816916c0, State: Running, Role: LEADER
I20260620 14:48:07.512993 9977 consensus_queue.cc:237] T 17c70368ee9e4328bd780654572e1905 P c0e6c57ab91e42bf9be3739c816916c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.515268 10123 raft_consensus.cc:482] T 1c7ec92b27c444b2bc03a1993959de26 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:07.515419 10123 raft_consensus.cc:504] T 1c7ec92b27c444b2bc03a1993959de26 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.515992 10123 leader_election.cc:288] T 1c7ec92b27c444b2bc03a1993959de26 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:48:07.516407 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7ec92b27c444b2bc03a1993959de26" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:48:07.516431 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7ec92b27c444b2bc03a1993959de26" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:48:07.516635 8659 raft_consensus.cc:2454] T 1c7ec92b27c444b2bc03a1993959de26 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:48:07.516646 8799 raft_consensus.cc:2454] T 1c7ec92b27c444b2bc03a1993959de26 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:48:07.517024 8871 leader_election.cc:302] T 1c7ec92b27c444b2bc03a1993959de26 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4; no voters:
I20260620 14:48:07.517308 10123 raft_consensus.cc:2781] T 1c7ec92b27c444b2bc03a1993959de26 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:48:07.517403 10123 raft_consensus.cc:482] T 1c7ec92b27c444b2bc03a1993959de26 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:48:07.517508 10123 raft_consensus.cc:3037] T 1c7ec92b27c444b2bc03a1993959de26 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:48:07.519390 10123 raft_consensus.cc:504] T 1c7ec92b27c444b2bc03a1993959de26 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.519893 10123 leader_election.cc:288] T 1c7ec92b27c444b2bc03a1993959de26 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Requested vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:48:07.520316 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7ec92b27c444b2bc03a1993959de26" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:48:07.520534 8799 raft_consensus.cc:3037] T 1c7ec92b27c444b2bc03a1993959de26 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:48:07.520633 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7ec92b27c444b2bc03a1993959de26" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:48:07.520804 10096 raft_consensus.cc:482] T 7fe9685389a04338a0c2ff23cac957d3 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:07.520885 8659 raft_consensus.cc:3037] T 1c7ec92b27c444b2bc03a1993959de26 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:48:07.520977 10096 raft_consensus.cc:504] T 7fe9685389a04338a0c2ff23cac957d3 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.521636 10096 leader_election.cc:288] T 7fe9685389a04338a0c2ff23cac957d3 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:48:07.522310 8662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fe9685389a04338a0c2ff23cac957d3" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:48:07.522518 8662 raft_consensus.cc:2454] T 7fe9685389a04338a0c2ff23cac957d3 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 0.
I20260620 14:48:07.522117 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fe9685389a04338a0c2ff23cac957d3" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4" is_pre_election: true
I20260620 14:48:07.522894 8935 raft_consensus.cc:2454] T 7fe9685389a04338a0c2ff23cac957d3 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 0.
I20260620 14:48:07.522909 8733 leader_election.cc:302] T 7fe9685389a04338a0c2ff23cac957d3 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:48:07.523110 8799 raft_consensus.cc:2454] T 1c7ec92b27c444b2bc03a1993959de26 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:48:07.523187 10096 raft_consensus.cc:2781] T 7fe9685389a04338a0c2ff23cac957d3 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:48:07.523283 10096 raft_consensus.cc:482] T 7fe9685389a04338a0c2ff23cac957d3 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:48:07.523402 10096 raft_consensus.cc:3037] T 7fe9685389a04338a0c2ff23cac957d3 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:48:07.523566 8659 raft_consensus.cc:2454] T 1c7ec92b27c444b2bc03a1993959de26 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:48:07.523651 8871 leader_election.cc:302] T 1c7ec92b27c444b2bc03a1993959de26 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4; no voters:
I20260620 14:48:07.523953 10123 raft_consensus.cc:2781] T 1c7ec92b27c444b2bc03a1993959de26 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:48:07.524111 10123 raft_consensus.cc:686] T 1c7ec92b27c444b2bc03a1993959de26 P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Becoming Leader. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Running, Role: LEADER
I20260620 14:48:07.524798 10123 consensus_queue.cc:237] T 1c7ec92b27c444b2bc03a1993959de26 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.526242 10096 raft_consensus.cc:504] T 7fe9685389a04338a0c2ff23cac957d3 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.526844 10096 leader_election.cc:288] T 7fe9685389a04338a0c2ff23cac957d3 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 election: Requested vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:48:07.527179 8935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fe9685389a04338a0c2ff23cac957d3" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c99207e35f8463292d71c371c9546b4"
I20260620 14:48:07.527261 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fe9685389a04338a0c2ff23cac957d3" candidate_uuid: "36236dd5bd604ba2819038e525a3790c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:48:07.527410 8935 raft_consensus.cc:3037] T 7fe9685389a04338a0c2ff23cac957d3 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:48:07.527482 8659 raft_consensus.cc:3037] T 7fe9685389a04338a0c2ff23cac957d3 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:48:07.529400 8659 raft_consensus.cc:2454] T 7fe9685389a04338a0c2ff23cac957d3 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 1.
I20260620 14:48:07.529477 8935 raft_consensus.cc:2454] T 7fe9685389a04338a0c2ff23cac957d3 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36236dd5bd604ba2819038e525a3790c in term 1.
I20260620 14:48:07.529804 8733 leader_election.cc:302] T 7fe9685389a04338a0c2ff23cac957d3 P 36236dd5bd604ba2819038e525a3790c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:48:07.530612 10096 raft_consensus.cc:2781] T 7fe9685389a04338a0c2ff23cac957d3 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:48:07.530793 10096 raft_consensus.cc:686] T 7fe9685389a04338a0c2ff23cac957d3 P 36236dd5bd604ba2819038e525a3790c [term 1 LEADER]: Becoming Leader. State: Replica: 36236dd5bd604ba2819038e525a3790c, State: Running, Role: LEADER
I20260620 14:48:07.531033 10096 consensus_queue.cc:237] T 7fe9685389a04338a0c2ff23cac957d3 P 36236dd5bd604ba2819038e525a3790c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.628139 10123 raft_consensus.cc:482] T 776892be9b4b49b58d9812970e51d1e5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:07.628331 10123 raft_consensus.cc:504] T 776892be9b4b49b58d9812970e51d1e5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.629177 10123 leader_election.cc:288] T 776892be9b4b49b58d9812970e51d1e5 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:48:07.629541 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "776892be9b4b49b58d9812970e51d1e5" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:48:07.629776 8799 raft_consensus.cc:2454] T 776892be9b4b49b58d9812970e51d1e5 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:48:07.629758 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "776892be9b4b49b58d9812970e51d1e5" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:48:07.630031 8659 raft_consensus.cc:2454] T 776892be9b4b49b58d9812970e51d1e5 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:48:07.630228 8871 leader_election.cc:302] T 776892be9b4b49b58d9812970e51d1e5 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4; no voters:
I20260620 14:48:07.630534 10123 raft_consensus.cc:2781] T 776892be9b4b49b58d9812970e51d1e5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:48:07.630611 10123 raft_consensus.cc:482] T 776892be9b4b49b58d9812970e51d1e5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:48:07.630726 10123 raft_consensus.cc:3037] T 776892be9b4b49b58d9812970e51d1e5 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:48:07.632558 10123 raft_consensus.cc:504] T 776892be9b4b49b58d9812970e51d1e5 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.633172 10123 leader_election.cc:288] T 776892be9b4b49b58d9812970e51d1e5 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Requested vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:48:07.633697 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "776892be9b4b49b58d9812970e51d1e5" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:48:07.633697 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "776892be9b4b49b58d9812970e51d1e5" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:48:07.633889 8659 raft_consensus.cc:3037] T 776892be9b4b49b58d9812970e51d1e5 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:48:07.633916 8799 raft_consensus.cc:3037] T 776892be9b4b49b58d9812970e51d1e5 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:48:07.636291 8799 raft_consensus.cc:2454] T 776892be9b4b49b58d9812970e51d1e5 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:48:07.636629 8871 leader_election.cc:302] T 776892be9b4b49b58d9812970e51d1e5 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4; no voters:
I20260620 14:48:07.636895 10123 raft_consensus.cc:2781] T 776892be9b4b49b58d9812970e51d1e5 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:48:07.637058 10123 raft_consensus.cc:686] T 776892be9b4b49b58d9812970e51d1e5 P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Becoming Leader. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Running, Role: LEADER
I20260620 14:48:07.637296 8659 raft_consensus.cc:2454] T 776892be9b4b49b58d9812970e51d1e5 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:48:07.637288 10123 consensus_queue.cc:237] T 776892be9b4b49b58d9812970e51d1e5 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.639070 10123 raft_consensus.cc:482] T 31e1bc87e526443e93e1f7d9b79659a7 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:07.639221 10123 raft_consensus.cc:504] T 31e1bc87e526443e93e1f7d9b79659a7 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.639787 10123 leader_election.cc:288] T 31e1bc87e526443e93e1f7d9b79659a7 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:48:07.640275 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31e1bc87e526443e93e1f7d9b79659a7" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c" is_pre_election: true
I20260620 14:48:07.640499 8799 raft_consensus.cc:2454] T 31e1bc87e526443e93e1f7d9b79659a7 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:48:07.640892 8871 leader_election.cc:302] T 31e1bc87e526443e93e1f7d9b79659a7 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4; no voters:
I20260620 14:48:07.641125 10123 raft_consensus.cc:2781] T 31e1bc87e526443e93e1f7d9b79659a7 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 14:48:07.641243 10123 raft_consensus.cc:482] T 31e1bc87e526443e93e1f7d9b79659a7 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:48:07.641172 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31e1bc87e526443e93e1f7d9b79659a7" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0" is_pre_election: true
I20260620 14:48:07.641324 10123 raft_consensus.cc:3037] T 31e1bc87e526443e93e1f7d9b79659a7 P 6c99207e35f8463292d71c371c9546b4 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:48:07.641399 8659 raft_consensus.cc:2454] T 31e1bc87e526443e93e1f7d9b79659a7 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 0.
I20260620 14:48:07.643229 10123 raft_consensus.cc:504] T 31e1bc87e526443e93e1f7d9b79659a7 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
I20260620 14:48:07.643846 10123 leader_election.cc:288] T 31e1bc87e526443e93e1f7d9b79659a7 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Requested vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:48:07.644161 8799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31e1bc87e526443e93e1f7d9b79659a7" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36236dd5bd604ba2819038e525a3790c"
I20260620 14:48:07.644272 8659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31e1bc87e526443e93e1f7d9b79659a7" candidate_uuid: "6c99207e35f8463292d71c371c9546b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0e6c57ab91e42bf9be3739c816916c0"
I20260620 14:48:07.644384 8799 raft_consensus.cc:3037] T 31e1bc87e526443e93e1f7d9b79659a7 P 36236dd5bd604ba2819038e525a3790c [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:48:07.644482 8659 raft_consensus.cc:3037] T 31e1bc87e526443e93e1f7d9b79659a7 P c0e6c57ab91e42bf9be3739c816916c0 [term 0 FOLLOWER]: Advancing to term 1
I20260620 14:48:07.647110 8659 raft_consensus.cc:2454] T 31e1bc87e526443e93e1f7d9b79659a7 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:48:07.647111 8799 raft_consensus.cc:2454] T 31e1bc87e526443e93e1f7d9b79659a7 P 36236dd5bd604ba2819038e525a3790c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c99207e35f8463292d71c371c9546b4 in term 1.
I20260620 14:48:07.647478 8869 leader_election.cc:302] T 31e1bc87e526443e93e1f7d9b79659a7 P 6c99207e35f8463292d71c371c9546b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c99207e35f8463292d71c371c9546b4, c0e6c57ab91e42bf9be3739c816916c0; no voters:
I20260620 14:48:07.647791 10123 raft_consensus.cc:2781] T 31e1bc87e526443e93e1f7d9b79659a7 P 6c99207e35f8463292d71c371c9546b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 14:48:07.647943 10123 raft_consensus.cc:686] T 31e1bc87e526443e93e1f7d9b79659a7 P 6c99207e35f8463292d71c371c9546b4 [term 1 LEADER]: Becoming Leader. State: Replica: 6c99207e35f8463292d71c371c9546b4, State: Running, Role: LEADER
I20260620 14:48:07.648212 10123 consensus_queue.cc:237] T 31e1bc87e526443e93e1f7d9b79659a7 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } }
W20260620 14:48:07.859400 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 6: this message will repeat every 5th retry.
I20260620 14:48:08.001629 10151 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dd308569015348a7a19ba4a560de6d52)
I20260620 14:48:08.001837 10151 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:08.002482 10151 leader_election.cc:288] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209)
W20260620 14:48:08.004427 9979 leader_election.cc:334] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:48:08.004845 9981 leader_election.cc:334] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209): Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
I20260620 14:48:08.004993 9981 leader_election.cc:302] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61512e6d316d4d3a998e52511a0bba7a; no voters: caa9dcf251944f7d97f4ed7f3d83af44, dd308569015348a7a19ba4a560de6d52
I20260620 14:48:08.005245 10151 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 14:48:08.142254 10096 consensus_queue.cc:1035] T e29636c50e7f49a9b086c475b2b8cc2f P 36236dd5bd604ba2819038e525a3790c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:48:08.149443 10096 consensus_queue.cc:1035] T e29636c50e7f49a9b086c475b2b8cc2f P 36236dd5bd604ba2819038e525a3790c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:48:08.161504 10123 consensus_queue.cc:1035] T a8aa5397f7914b83a1d94bd14455f98d P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:48:08.168344 10123 consensus_queue.cc:1035] T a8aa5397f7914b83a1d94bd14455f98d P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:48:08.296403 10168 consensus_queue.cc:1035] T 16ecb528da2746fda47d12a11af8b774 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:48:08.302935 10167 consensus_queue.cc:1035] T 16ecb528da2746fda47d12a11af8b774 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:48:08.307356 10159 consensus_queue.cc:1035] T 7fe9685389a04338a0c2ff23cac957d3 P 36236dd5bd604ba2819038e525a3790c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:48:08.313549 10159 consensus_queue.cc:1035] T 7fe9685389a04338a0c2ff23cac957d3 P 36236dd5bd604ba2819038e525a3790c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:48:08.318048 10167 consensus_queue.cc:1035] T 1c7ec92b27c444b2bc03a1993959de26 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:48:08.326776 10167 consensus_queue.cc:1035] T 1c7ec92b27c444b2bc03a1993959de26 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:48:08.378707 10167 consensus_queue.cc:1035] T 76cc8408ccc842ecac157fbc92540f2d P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:48:08.384299 10167 consensus_queue.cc:1035] T 76cc8408ccc842ecac157fbc92540f2d P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:48:08.406998 10150 consensus_queue.cc:1035] T 17c70368ee9e4328bd780654572e1905 P c0e6c57ab91e42bf9be3739c816916c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:48:08.412161 9977 consensus_queue.cc:1035] T 17c70368ee9e4328bd780654572e1905 P c0e6c57ab91e42bf9be3739c816916c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:48:08.444147 10167 consensus_queue.cc:1035] T 31e1bc87e526443e93e1f7d9b79659a7 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:48:08.452145 10167 consensus_queue.cc:1035] T 31e1bc87e526443e93e1f7d9b79659a7 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:48:08.532967 8059 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task9VKlbC/build/asan/bin/kudu pid 9960
I20260620 14:48:08.540643 10025 generic_service.cc:196] Checking for leaks (request via RPC)
I20260620 14:48:08.569988 9976 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:48:08.570313 9976 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:48:08.571020 9976 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:48:08.571988 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:48:08.572118 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:48:08.572208 8598 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:48:08.572500 9976 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:48:08.585800 10167 consensus_queue.cc:1035] T 776892be9b4b49b58d9812970e51d1e5 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:48:08.591050 10167 consensus_queue.cc:1035] T 776892be9b4b49b58d9812970e51d1e5 P 6c99207e35f8463292d71c371c9546b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 14:48:08.660280 10190 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dd308569015348a7a19ba4a560de6d52)
I20260620 14:48:08.660526 10190 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:08.661028 8059 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9VKlbC/build/asan/bin/kudu with pid 9960
I20260620 14:48:09.473429 8059 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9VKlbC/build/asan/bin/kudu
/tmp/dist-test-task9VKlbC/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.222.252:36651
--webserver_interface=127.7.222.252
--webserver_port=40883
--builtin_ntp_servers=127.7.222.212:42755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--hive_metastore_uris=thrift://127.0.0.1:42797
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260620 14:48:09.828238 10196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:48:09.828696 10196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:48:09.828879 10196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:48:09.838483 10196 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:48:09.838649 10196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:48:09.838734 10196 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:48:09.838802 10196 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:48:09.849661 10196 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.222.212:42755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:42797
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.222.252:36651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.222.252
--webserver_port=40883
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 13:41:20 UTC on ccycloud.quasar-vdagoi.root.comops.site
build id 4457462
ASAN enabled
I20260620 14:48:09.851279 10196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:48:09.853520 10196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:48:09.866438 10202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:48:09.866537 10204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:48:09.866492 10201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:48:09.867401 10196 server_base.cc:1034] running on GCE node
I20260620 14:48:09.868295 10196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:48:09.870050 10196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:48:09.871371 10196 hybrid_clock.cc:648] HybridClock initialized: now 1781966889871252 us; error 62 us; skew 500 ppm
I20260620 14:48:09.871829 10196 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 14:48:09.874560 10196 webserver.cc:460] Webserver started at http://127.7.222.252:40883/ using document root <none> and password file <none>
I20260620 14:48:09.875380 10196 fs_manager.cc:359] Metadata directory not provided
I20260620 14:48:09.875540 10196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:48:09.881676 10196 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260620 14:48:09.885093 10210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:48:09.886898 10196 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260620 14:48:09.887143 10196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/data,/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/wal
uuid: "61512e6d316d4d3a998e52511a0bba7a"
format_stamp: "Formatted at 2026-06-20 14:47:46 on dist-test-slave-c599"
I20260620 14:48:09.888141 10196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:48:09.902093 10196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:48:09.902936 10196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:48:09.903187 10196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:48:09.923043 10196 rpc_server.cc:307] RPC server started. Bound to: 127.7.222.252:36651
I20260620 14:48:09.923065 10261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.222.252:36651 every 8 connection(s)
I20260620 14:48:09.924681 10196 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-2/data/info.pb
I20260620 14:48:09.931348 10262 sys_catalog.cc:263] Verifying existing consensus state
I20260620 14:48:09.933645 8059 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9VKlbC/build/asan/bin/kudu as pid 10196
I20260620 14:48:09.935439 10262 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: Bootstrap starting.
I20260620 14:48:09.957166 10262 log.cc:824] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: Log is configured to *not* fsync() on all Append() calls
I20260620 14:48:10.037716 10262 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: Bootstrap replayed 1/1 log segments. Stats: ops{read=108 overwritten=0 applied=108 ignored=0} inserts{seen=75 ignored=0} mutations{seen=97 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 14:48:10.038468 10262 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: Bootstrap complete.
I20260620 14:48:10.045534 8845 heartbeater.cc:347] Connected to a master server at 127.7.222.252:36651
I20260620 14:48:10.047423 10262 raft_consensus.cc:348] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:10.048571 10262 raft_consensus.cc:729] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61512e6d316d4d3a998e52511a0bba7a, State: Initialized, Role: FOLLOWER
I20260620 14:48:10.049206 10262 consensus_queue.cc:260] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 108, Last appended: 6.108, Last appended by leader: 108, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:10.050150 10268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:48:10.050487 10268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:48:10.051489 10262 sys_catalog.cc:564] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:48:10.072002 10282 catalog_manager.cc:1259] Loaded cluster ID: 700994c053c643c896af12c77a108604
I20260620 14:48:10.072229 10282 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: loading cluster ID for follower catalog manager: success
I20260620 14:48:10.078836 10282 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: acquiring CA information for follower catalog manager: success
I20260620 14:48:10.070629 10196 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:48:10.082111 10196 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:48:10.083534 10282 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 14:48:10.093783 8980 heartbeater.cc:347] Connected to a master server at 127.7.222.252:36651
I20260620 14:48:10.097347 10227 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6c99207e35f8463292d71c371c9546b4" instance_seqno: 1781966868961030) as {username='slave'} at 127.7.222.195:53959; Asking this server to re-register.
I20260620 14:48:10.098097 8980 heartbeater.cc:464] Registering TS with master...
I20260620 14:48:10.100006 10227 ts_manager.cc:194] Registered new tserver with Master: 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:48:10.248118 8707 heartbeater.cc:347] Connected to a master server at 127.7.222.252:36651
I20260620 14:48:10.250157 10227 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" instance_seqno: 1781966867942712) as {username='slave'} at 127.7.222.193:36587; Asking this server to re-register.
I20260620 14:48:10.250847 8707 heartbeater.cc:464] Registering TS with master...
I20260620 14:48:10.252614 10227 ts_manager.cc:194] Registered new tserver with Master: c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:48:10.489599 10268 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:10.489938 10268 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:10.492210 10268 leader_election.cc:288] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209)
W20260620 14:48:10.492787 10211 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:48:10.494592 10211 leader_election.cc:334] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:48:10.494841 10213 leader_election.cc:334] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209): Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
I20260620 14:48:10.495083 10213 leader_election.cc:302] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61512e6d316d4d3a998e52511a0bba7a; no voters: caa9dcf251944f7d97f4ed7f3d83af44, dd308569015348a7a19ba4a560de6d52
I20260620 14:48:10.495424 10268 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 14:48:10.550551 10227 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "36236dd5bd604ba2819038e525a3790c" instance_seqno: 1781966868431821) as {username='slave'} at 127.7.222.194:48041; Asking this server to re-register.
I20260620 14:48:10.551308 8845 heartbeater.cc:464] Registering TS with master...
I20260620 14:48:10.552996 10227 ts_manager.cc:194] Registered new tserver with Master: 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:48:11.119172 10297 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:11.119372 10297 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:11.120151 10297 leader_election.cc:288] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209)
W20260620 14:48:11.122553 10211 leader_election.cc:334] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:48:11.122817 10213 leader_election.cc:334] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209): Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
I20260620 14:48:11.122972 10213 leader_election.cc:302] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61512e6d316d4d3a998e52511a0bba7a; no voters: caa9dcf251944f7d97f4ed7f3d83af44, dd308569015348a7a19ba4a560de6d52
I20260620 14:48:11.123236 10297 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 14:48:11.670136 10305 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:11.670302 10305 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:11.671096 10305 leader_election.cc:288] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209)
W20260620 14:48:11.673476 10211 leader_election.cc:334] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:48:11.673684 10213 leader_election.cc:334] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209): Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
I20260620 14:48:11.673794 10213 leader_election.cc:302] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61512e6d316d4d3a998e52511a0bba7a; no voters: caa9dcf251944f7d97f4ed7f3d83af44, dd308569015348a7a19ba4a560de6d52
I20260620 14:48:11.673995 10305 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 14:48:11.914844 10293 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:48:11.915109 10293 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:48:11.915752 10293 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:48:11.916875 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:48:11.917058 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:48:11.917174 8596 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:48:11.917470 10293 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:48:11.996224 10293 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:48:11.996443 10293 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:48:11.997121 10293 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:48:11.998055 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:48:11.998239 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:48:11.998343 8596 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:48:11.998570 10293 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:48:12.051126 10293 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:48:12.051347 10293 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:48:12.052059 10293 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:48:12.052935 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:48:12.053160 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:48:12.053272 8596 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:48:12.053515 10293 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:48:12.763164 10321 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:12.763424 10321 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:12.764082 10321 leader_election.cc:288] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209)
W20260620 14:48:12.766382 10211 leader_election.cc:334] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:48:12.766711 10213 leader_election.cc:334] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209): Network error: Client connection negotiation failed: client connection to 127.7.222.253:34209: connect: Connection refused (error 111)
I20260620 14:48:12.766830 10213 leader_election.cc:302] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61512e6d316d4d3a998e52511a0bba7a; no voters: caa9dcf251944f7d97f4ed7f3d83af44, dd308569015348a7a19ba4a560de6d52
I20260620 14:48:12.767084 10321 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 14:48:12.981137 8059 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9VKlbC/build/asan/bin/kudu
/tmp/dist-test-task9VKlbC/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.222.253:34209
--webserver_interface=127.7.222.253
--webserver_port=40901
--builtin_ntp_servers=127.7.222.212:42755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--hive_metastore_uris=thrift://127.0.0.1:42797
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260620 14:48:13.331178 10327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:48:13.331642 10327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:48:13.331815 10327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:48:13.342320 10327 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:48:13.342447 10327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:48:13.342496 10327 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:48:13.342559 10327 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:48:13.352553 10327 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.222.212:42755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:42797
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.222.253:34209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.222.253
--webserver_port=40901
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 13:41:20 UTC on ccycloud.quasar-vdagoi.root.comops.site
build id 4457462
ASAN enabled
I20260620 14:48:13.354218 10327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:48:13.356158 10327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:48:13.368507 10338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:48:13.368603 10337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:48:13.368820 10340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:48:13.369838 10327 server_base.cc:1034] running on GCE node
I20260620 14:48:13.370771 10327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:48:13.372325 10327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:48:13.373528 10327 hybrid_clock.cc:648] HybridClock initialized: now 1781966893373468 us; error 41 us; skew 500 ppm
I20260620 14:48:13.373874 10327 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 14:48:13.376294 10327 webserver.cc:460] Webserver started at http://127.7.222.253:40901/ using document root <none> and password file <none>
I20260620 14:48:13.377082 10327 fs_manager.cc:359] Metadata directory not provided
I20260620 14:48:13.377214 10327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:48:13.382810 10327 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260620 14:48:13.386070 10346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:48:13.387604 10327 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260620 14:48:13.387813 10327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data,/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
uuid: "caa9dcf251944f7d97f4ed7f3d83af44"
format_stamp: "Formatted at 2026-06-20 14:47:46 on dist-test-slave-c599"
I20260620 14:48:13.388983 10327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:48:13.403918 10327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:48:13.404942 10327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:48:13.405205 10327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:48:13.425625 10327 rpc_server.cc:307] RPC server started. Bound to: 127.7.222.253:34209
I20260620 14:48:13.425668 10397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.222.253:34209 every 8 connection(s)
I20260620 14:48:13.427199 10327 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data/info.pb
I20260620 14:48:13.432240 8059 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9VKlbC/build/asan/bin/kudu as pid 10327
I20260620 14:48:13.434324 10398 sys_catalog.cc:263] Verifying existing consensus state
I20260620 14:48:13.438612 10398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Bootstrap starting.
I20260620 14:48:13.458509 10398 log.cc:824] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Log is configured to *not* fsync() on all Append() calls
I20260620 14:48:13.532102 10398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Bootstrap replayed 1/1 log segments. Stats: ops{read=102 overwritten=0 applied=99 ignored=0} inserts{seen=70 ignored=0} mutations{seen=83 ignored=0} orphaned_commits=0. Pending: 3 replicates
I20260620 14:48:13.532733 10398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Bootstrap complete.
I20260620 14:48:13.541065 10398 raft_consensus.cc:348] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 5 FOLLOWER]: Replica starting. Triggering 3 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:13.544445 10398 raft_consensus.cc:729] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa9dcf251944f7d97f4ed7f3d83af44, State: Initialized, Role: FOLLOWER
I20260620 14:48:13.545253 10398 consensus_queue.cc:260] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 99, Last appended: 5.102, Last appended by leader: 102, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:13.546056 10403 sys_catalog.cc:455] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:48:13.546434 10403 sys_catalog.cc:458] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:48:13.547109 10398 sys_catalog.cc:564] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:48:13.561343 8847 heartbeater.cc:347] Connected to a master server at 127.7.222.253:34209
I20260620 14:48:13.566570 10363 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "36236dd5bd604ba2819038e525a3790c" instance_seqno: 1781966868431821) as {username='slave'} at 127.7.222.194:34813; Asking this server to re-register.
I20260620 14:48:13.566977 10419 catalog_manager.cc:1259] Loaded cluster ID: 700994c053c643c896af12c77a108604
I20260620 14:48:13.567510 8847 heartbeater.cc:464] Registering TS with master...
I20260620 14:48:13.569454 10419 catalog_manager.cc:1552] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: loading cluster ID for follower catalog manager: success
I20260620 14:48:13.572908 10363 ts_manager.cc:194] Registered new tserver with Master: 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:48:13.575551 10419 catalog_manager.cc:1574] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: acquiring CA information for follower catalog manager: success
I20260620 14:48:13.579485 10419 catalog_manager.cc:1602] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 14:48:13.582433 10327 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:48:13.589915 10327 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:48:13.602066 8982 heartbeater.cc:347] Connected to a master server at 127.7.222.253:34209
I20260620 14:48:13.604564 10362 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6c99207e35f8463292d71c371c9546b4" instance_seqno: 1781966868961030) as {username='slave'} at 127.7.222.195:47427; Asking this server to re-register.
I20260620 14:48:13.605453 8982 heartbeater.cc:464] Registering TS with master...
I20260620 14:48:13.607265 10362 ts_manager.cc:194] Registered new tserver with Master: 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:48:13.847332 8709 heartbeater.cc:347] Connected to a master server at 127.7.222.253:34209
I20260620 14:48:13.850378 10362 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" instance_seqno: 1781966867942712) as {username='slave'} at 127.7.222.193:33327; Asking this server to re-register.
I20260620 14:48:13.851120 8709 heartbeater.cc:464] Registering TS with master...
I20260620 14:48:13.853312 10362 ts_manager.cc:194] Registered new tserver with Master: c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
I20260620 14:48:14.119477 10425 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:14.119782 10425 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:14.121886 10425 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:48:14.123410 10347 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:48:14.124969 10347 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:48:14.129618 10237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" candidate_term: 6 candidate_status { last_received { term: 5 index: 102 } } ignore_live_leader: false dest_uuid: "61512e6d316d4d3a998e52511a0bba7a" is_pre_election: true
I20260620 14:48:14.130066 10237 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate caa9dcf251944f7d97f4ed7f3d83af44 in current term 6: Already voted for candidate dd308569015348a7a19ba4a560de6d52 in this term.
I20260620 14:48:14.130875 10350 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:48:14.131266 10425 raft_consensus.cc:3037] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 5 FOLLOWER]: Advancing to term 6
I20260620 14:48:14.134756 10425 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260620 14:48:14.767560 10437 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:14.767771 10437 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:14.768800 10437 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
I20260620 14:48:14.769105 10237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" candidate_term: 7 candidate_status { last_received { term: 5 index: 102 } } ignore_live_leader: false dest_uuid: "61512e6d316d4d3a998e52511a0bba7a" is_pre_election: true
I20260620 14:48:14.769456 10237 raft_consensus.cc:2396] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate caa9dcf251944f7d97f4ed7f3d83af44 for term 7 because replica has last-logged OpId of term: 6 index: 108, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 102.
W20260620 14:48:14.770823 10347 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:48:14.770965 10347 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:48:14.771258 10437 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260620 14:48:14.814932 10440 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:14.815199 10440 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:14.815985 10440 leader_election.cc:288] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209)
W20260620 14:48:14.819553 10211 leader_election.cc:334] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:48:14.824419 10373 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "61512e6d316d4d3a998e52511a0bba7a" candidate_term: 7 candidate_status { last_received { term: 6 index: 108 } } ignore_live_leader: false dest_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" is_pre_election: true
I20260620 14:48:14.824921 10373 raft_consensus.cc:2454] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61512e6d316d4d3a998e52511a0bba7a in term 6.
I20260620 14:48:14.825525 10213 leader_election.cc:302] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61512e6d316d4d3a998e52511a0bba7a, caa9dcf251944f7d97f4ed7f3d83af44; no voters: dd308569015348a7a19ba4a560de6d52
I20260620 14:48:14.825796 10440 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260620 14:48:14.825946 10440 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 14:48:14.826030 10440 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 6 FOLLOWER]: Advancing to term 7
I20260620 14:48:14.829869 10440 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:14.830422 10440 leader_election.cc:288] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 election: Requested vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), caa9dcf251944f7d97f4ed7f3d83af44 (127.7.222.253:34209)
I20260620 14:48:14.830919 10373 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "61512e6d316d4d3a998e52511a0bba7a" candidate_term: 7 candidate_status { last_received { term: 6 index: 108 } } ignore_live_leader: false dest_uuid: "caa9dcf251944f7d97f4ed7f3d83af44"
I20260620 14:48:14.831151 10373 raft_consensus.cc:3037] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 6 FOLLOWER]: Advancing to term 7
W20260620 14:48:14.831775 10211 leader_election.cc:334] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:48:14.833434 10373 raft_consensus.cc:2454] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61512e6d316d4d3a998e52511a0bba7a in term 7.
I20260620 14:48:14.833861 10213 leader_election.cc:302] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61512e6d316d4d3a998e52511a0bba7a, caa9dcf251944f7d97f4ed7f3d83af44; no voters: dd308569015348a7a19ba4a560de6d52
I20260620 14:48:14.834168 10440 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 7 FOLLOWER]: Leader election won for term 7
I20260620 14:48:14.834626 10440 raft_consensus.cc:686] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [term 7 LEADER]: Becoming Leader. State: Replica: 61512e6d316d4d3a998e52511a0bba7a, State: Running, Role: LEADER
I20260620 14:48:14.835117 10440 consensus_queue.cc:237] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 108, Committed index: 108, Last appended: 6.108, Last appended by leader: 108, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:14.837936 10445 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61512e6d316d4d3a998e52511a0bba7a. Latest consensus state: current_term: 7 leader_uuid: "61512e6d316d4d3a998e52511a0bba7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:48:14.838378 10445 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [sys.catalog]: This master's current role is: LEADER
I20260620 14:48:14.839015 10447 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 14:48:14.841960 10447 catalog_manager.cc:669] Loaded metadata for table default.table_4ab72ecdb6d540508f6f4b250020b540 [id=0c4867ea1c1e45f388ccd4e2c9de093e]
I20260620 14:48:14.842573 10447 catalog_manager.cc:669] Loaded metadata for table default.table_8cc72697ee4f4200a5f57a19280315ee [id=1db81c7e90894c5fac0e8fe34d1d4441]
I20260620 14:48:14.843118 10447 catalog_manager.cc:669] Loaded metadata for table default.table_105950e097bf4cbda12e7532557966b2 [id=34076de884f942fcb696a9c9524941e7]
I20260620 14:48:14.843482 10447 catalog_manager.cc:669] Loaded metadata for table default.table_0eb776233cee4294b6c96ec556447663 [id=3420fc1c9c8b45f49aeaa7b4c97da51e]
I20260620 14:48:14.843947 10447 catalog_manager.cc:669] Loaded metadata for table default.table_154fc524efb24453bdb6d735e4c741e9 [id=3b08ae3b47fd46cab8ef5a41bb0bc5d7]
I20260620 14:48:14.844295 10447 catalog_manager.cc:669] Loaded metadata for table default.table_bb493f9370e74bafae7b1e42f5c5f770 [id=6a722b39b30e45649b7b70c32c9e2260]
I20260620 14:48:14.844565 10447 catalog_manager.cc:669] Loaded metadata for table default.table_7911231c2bcb420ebe8f3e12604c29e4 [id=76fec3007aa94f71867761f887e9b73e]
I20260620 14:48:14.844903 10447 catalog_manager.cc:669] Loaded metadata for table default.table_16339630485f49f6a8bb2b71981cdeb1 [id=7d2156b55c1349b2841c1d2676f74993]
I20260620 14:48:14.845166 10447 catalog_manager.cc:669] Loaded metadata for table default.table_563392802bec4e688c0eabd46ab1fd5c [id=7e71694fb4a948f09c01863575227fda]
I20260620 14:48:14.845557 10447 catalog_manager.cc:669] Loaded metadata for table default.table_fdbead99862d49af98df44683e830bf5 [id=85b633c4801d49bd9ad9b944b178e683]
I20260620 14:48:14.845801 10447 catalog_manager.cc:669] Loaded metadata for table default.table_98318448fcf3484cb76812dad2975098 [id=862dd3cee25c40eead9feb394a8b58b1]
I20260620 14:48:14.846051 10447 catalog_manager.cc:669] Loaded metadata for table default.table_19c624001d444b7b9939e22128c594aa [id=98d2e7b647544a97b50827a0cb2799a0]
I20260620 14:48:14.846303 10447 catalog_manager.cc:669] Loaded metadata for table default.table_e8372b71bacb4865b4360a50af59d323 [id=9c1e21a6c9244efba2e86bfa28264a0d]
I20260620 14:48:14.846683 10447 catalog_manager.cc:669] Loaded metadata for table default.table_1ea7c21a49a443c29bd5578c5950c27f [id=bfa17da52a874fa1b587ad18d04cd740]
I20260620 14:48:14.846956 10447 catalog_manager.cc:669] Loaded metadata for table default.table_fe5ad6a8d59b4751bcbb6e1d0d4baedb [id=c514aca79062490a8b6a18021b07b2ff]
I20260620 14:48:14.847450 10447 catalog_manager.cc:669] Loaded metadata for table default.table_a901d915c377429a9e43cfcaf071e7d3 [id=c65e926af55d4fbba6c42f4d2ddbb397]
I20260620 14:48:14.847820 10447 catalog_manager.cc:669] Loaded metadata for table default.table_d2959bb621be429eb5af827263887798 [id=ddb41391569b4a11b4ad85335ca24ddb]
I20260620 14:48:14.850977 10447 tablet_loader.cc:96] loaded metadata for tablet 16ecb528da2746fda47d12a11af8b774 (table default.table_e8372b71bacb4865b4360a50af59d323 [id=9c1e21a6c9244efba2e86bfa28264a0d])
I20260620 14:48:14.851357 10447 tablet_loader.cc:96] loaded metadata for tablet 17c70368ee9e4328bd780654572e1905 (table default.table_154fc524efb24453bdb6d735e4c741e9 [id=3b08ae3b47fd46cab8ef5a41bb0bc5d7])
I20260620 14:48:14.852022 10447 tablet_loader.cc:96] loaded metadata for tablet 1c7ec92b27c444b2bc03a1993959de26 (table default.table_8cc72697ee4f4200a5f57a19280315ee [id=1db81c7e90894c5fac0e8fe34d1d4441])
I20260620 14:48:14.852445 10447 tablet_loader.cc:96] loaded metadata for tablet 26639d34678c4f77994cd44313b98898 (table default.table_16339630485f49f6a8bb2b71981cdeb1 [id=7d2156b55c1349b2841c1d2676f74993])
I20260620 14:48:14.853237 10447 tablet_loader.cc:96] loaded metadata for tablet 31e1bc87e526443e93e1f7d9b79659a7 (table default.table_0eb776233cee4294b6c96ec556447663 [id=3420fc1c9c8b45f49aeaa7b4c97da51e])
I20260620 14:48:14.854347 10447 tablet_loader.cc:96] loaded metadata for tablet 675413dc550f485dbef0d180ed27ff0e (table default.table_4ab72ecdb6d540508f6f4b250020b540 [id=0c4867ea1c1e45f388ccd4e2c9de093e])
I20260620 14:48:14.854710 10447 tablet_loader.cc:96] loaded metadata for tablet 73a17f00358f415d8b72a53859963eac (table default.table_7911231c2bcb420ebe8f3e12604c29e4 [id=76fec3007aa94f71867761f887e9b73e])
I20260620 14:48:14.855152 10447 tablet_loader.cc:96] loaded metadata for tablet 76cc8408ccc842ecac157fbc92540f2d (table default.table_fdbead99862d49af98df44683e830bf5 [id=85b633c4801d49bd9ad9b944b178e683])
I20260620 14:48:14.855561 10447 tablet_loader.cc:96] loaded metadata for tablet 776892be9b4b49b58d9812970e51d1e5 (table default.table_98318448fcf3484cb76812dad2975098 [id=862dd3cee25c40eead9feb394a8b58b1])
I20260620 14:48:14.856083 10447 tablet_loader.cc:96] loaded metadata for tablet 7a78d61e26c645b6bd82b6070c677b98 (table default.table_d2959bb621be429eb5af827263887798 [id=ddb41391569b4a11b4ad85335ca24ddb])
I20260620 14:48:14.856381 10447 tablet_loader.cc:96] loaded metadata for tablet 7fe9685389a04338a0c2ff23cac957d3 (table default.table_19c624001d444b7b9939e22128c594aa [id=98d2e7b647544a97b50827a0cb2799a0])
I20260620 14:48:14.856653 10447 tablet_loader.cc:96] loaded metadata for tablet 8caaa1b5e0384a6ab49b9fd7162896c8 (table default.table_bb493f9370e74bafae7b1e42f5c5f770 [id=6a722b39b30e45649b7b70c32c9e2260])
I20260620 14:48:14.856972 10447 tablet_loader.cc:96] loaded metadata for tablet 8e2d76b1afb147088869a6180d5bc03e (table default.table_105950e097bf4cbda12e7532557966b2 [id=34076de884f942fcb696a9c9524941e7])
I20260620 14:48:14.857506 10447 tablet_loader.cc:96] loaded metadata for tablet a8aa5397f7914b83a1d94bd14455f98d (table default.table_1ea7c21a49a443c29bd5578c5950c27f [id=bfa17da52a874fa1b587ad18d04cd740])
I20260620 14:48:14.857924 10447 tablet_loader.cc:96] loaded metadata for tablet bd541e6a431348c7a506611681730fc5 (table default.table_a901d915c377429a9e43cfcaf071e7d3 [id=c65e926af55d4fbba6c42f4d2ddbb397])
I20260620 14:48:14.858848 10447 tablet_loader.cc:96] loaded metadata for tablet e29636c50e7f49a9b086c475b2b8cc2f (table default.table_563392802bec4e688c0eabd46ab1fd5c [id=7e71694fb4a948f09c01863575227fda])
I20260620 14:48:14.859273 10447 tablet_loader.cc:96] loaded metadata for tablet eb6d101c1a5444cabf7c966c7ac7134e (table default.table_fe5ad6a8d59b4751bcbb6e1d0d4baedb [id=c514aca79062490a8b6a18021b07b2ff])
I20260620 14:48:14.859593 10447 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 14:48:14.861297 10447 catalog_manager.cc:1259] Loaded cluster ID: 700994c053c643c896af12c77a108604
I20260620 14:48:14.861409 10447 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 14:48:14.863252 10447 catalog_manager.cc:1504] Loading token signing keys...
I20260620 14:48:14.864845 10447 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: Loaded TSK: 0
I20260620 14:48:14.865837 10447 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 14:48:14.867462 10447 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260620 14:48:14.869019 10447 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: 27
I20260620 14:48:14.944721 10227 master_service.cc:946] ReplaceTablet: received request to replace tablet 309a0915648643ada08981a11e7a1e59 from {username='slave'} at 127.0.0.1:47576
I20260620 14:48:14.944939 10226 master_service.cc:946] ReplaceTablet: received request to replace tablet 1c7ec92b27c444b2bc03a1993959de26 from {username='slave'} at 127.0.0.1:47576
I20260620 14:48:14.946491 10225 master_service.cc:946] ReplaceTablet: received request to replace tablet 76cc8408ccc842ecac157fbc92540f2d from {username='slave'} at 127.0.0.1:47576
I20260620 14:48:14.946417 10223 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47576:
table { table_name: "default.Table_19c624001d444b7b9939e22128c594aa" } new_table_name: "default.Table_ed65359dea1b47aab601b55d6957c2dd" modify_external_catalogs: true
I20260620 14:48:14.947504 10227 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47576:
table { table_name: "default.Table_1ea7c21a49a443c29bd5578c5950c27f" } new_table_name: "default.Table_2b02aaacb2204d27a2fa683065bccc6b" modify_external_catalogs: true
I20260620 14:48:14.947778 10222 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47576:
table { table_name: "default.Table_0eb776233cee4294b6c96ec556447663" } modify_external_catalogs: true
I20260620 14:48:14.948176 10222 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47576:
table { table_name: "default.Table_0eb776233cee4294b6c96ec556447663" } modify_external_catalogs: true
I20260620 14:48:14.948709 10220 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47576:
table { table_name: "default.Table_bb493f9370e74bafae7b1e42f5c5f770" } modify_external_catalogs: true
I20260620 14:48:14.949047 10220 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47576:
table { table_name: "default.Table_bb493f9370e74bafae7b1e42f5c5f770" } modify_external_catalogs: true
I20260620 14:48:14.949683 10221 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47576:
name: "default.Table_ce174d6c98a242ab9c1ea68d35bd8c28"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:48:14.950377 10219 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47576:
name: "default.Table_13f389c96bd0448091e94f5127394533"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:48:14.950646 10224 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47576:
name: "default.Table_1d5a20c59b2741ca905b63fd9478cf1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:48:14.950436 10218 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47576:
name: "default.Table_34a7935bc68a42c3aa8f0c43b09b30a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260620 14:48:14.956543 10373 raft_consensus.cc:1261] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Refusing update from remote peer 61512e6d316d4d3a998e52511a0bba7a: Log matching property violated. Preceding OpId in replica: term: 5 index: 102. Preceding OpId from leader: term: 7 index: 110. (index mismatch)
I20260620 14:48:14.957517 10449 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 109, Last known committed idx: 99, Time since last communication: 0.000s
W20260620 14:48:14.958683 10211 consensus_peers.cc:487] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a -> Peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Couldn't send request to peer dd308569015348a7a19ba4a560de6d52. Status: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260620 14:48:14.959522 10281 catalog_manager.cc:2709] Deleting table default.table_2d00c2dfdbfe428a8de80587e6f6e918 [id=a17882ca0acc459caae49f8238c7df14] in response to Hive Metastore notification log event 28
W20260620 14:48:14.960034 10281 hms_notification_log_listener.cc:294] Failed to handle Hive Metastore notification: 28 DROP_TABLE default.table_2d00c2dfdbfe428a8de80587e6f6e918: Not found: the table does not exist: table_id: "a17882ca0acc459caae49f8238c7df14" table_name: "default.table_2d00c2dfdbfe428a8de80587e6f6e918"
F20260620 14:48:14.960180 10281 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 28): 28 CREATE_TABLE default.table_154fc524efb24453bdb6d735e4c741e9
*** Check failure stack trace: ***
@ 0x7f697b1ce9ad google::LogMessage::Fail() at ??:0
@ 0x7f697b1d188a google::LogMessage::SendToLog() at ??:0
@ 0x7f697b1ce4de google::LogMessage::Flush() at ??:0
@ 0x7f697b1ce6d1 google::LogMessage::~LogMessage() at ??:0
@ 0x7f6990d6cba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f6990d6b901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7f6990d7266c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260620 14:48:14.998090 10450 mvcc.cc:205] Tried to move back new op lower bound from 7298936368609370112 to 7298936365562085376. Current Snapshot: MvccSnapshot[applied={T|T < 7298936368609370112}]
I20260620 14:48:14.999079 10437 sys_catalog.cc:455] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61512e6d316d4d3a998e52511a0bba7a. Latest consensus state: current_term: 7 leader_uuid: "61512e6d316d4d3a998e52511a0bba7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:48:14.999437 10437 sys_catalog.cc:458] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:48:14.999396 10460 sys_catalog.cc:455] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "61512e6d316d4d3a998e52511a0bba7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:48:14.999738 10460 sys_catalog.cc:458] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:48:15.000074 10452 sys_catalog.cc:455] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "61512e6d316d4d3a998e52511a0bba7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:48:15.000437 10452 sys_catalog.cc:458] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f6990d724e9 std::_Function_handler<>::_M_invoke() at ??:0
I20260620 14:48:15.004985 10452 sys_catalog.cc:455] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "61512e6d316d4d3a998e52511a0bba7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:48:15.005240 10452 sys_catalog.cc:458] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x9edb7d std::function<>::operator()() at ??:?
I20260620 14:48:15.009198 10226 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: Sending DeleteTablet for 3 replicas of tablet 1c7ec92b27c444b2bc03a1993959de26
I20260620 14:48:15.009573 10225 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 61512e6d316d4d3a998e52511a0bba7a: Sending DeleteTablet for 3 replicas of tablet 76cc8408ccc842ecac157fbc92540f2d
I20260620 14:48:15.011289 10225 catalog_manager.cc:6565] ReplaceTablet: tablet 76cc8408ccc842ecac157fbc92540f2d deleted and replaced by tablet ba70e9fef29f41e898869e7b89ac13f6
@ 0x7f697ddf8eaf kudu::Thread::SuperviseThread() at ??:0
I20260620 14:48:15.015971 10226 catalog_manager.cc:6565] ReplaceTablet: tablet 1c7ec92b27c444b2bc03a1993959de26 deleted and replaced by tablet 6aa7b495c4204aed890ca24c998f176c
@ 0x7f69810d26db start_thread at ??:0
@ 0x7f697a06861f clone at ??:0
W20260620 14:48:15.199447 10468 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:48:15.013749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48800 (local address 127.7.222.194:39159)
0620 14:48:15.019567 (+ 5818us) server_negotiation.cc:206] Beginning negotiation
0620 14:48:15.019573 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0620 14:48:15.019598 (+ 25us) server_negotiation.cc:407] Connection header received
0620 14:48:15.019671 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:48:15.019676 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:48:15.019751 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:48:15.019854 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:48:15.199100 (+179246us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48800: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":5640,"thread_start_us":5504,"threads_started":1}
W20260620 14:48:15.199743 10467 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:48:15.013704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55346 (local address 127.7.222.195:45279)
0620 14:48:15.020948 (+ 7244us) server_negotiation.cc:206] Beginning negotiation
0620 14:48:15.020953 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0620 14:48:15.020973 (+ 20us) server_negotiation.cc:407] Connection header received
0620 14:48:15.021038 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0620 14:48:15.021043 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0620 14:48:15.021113 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0620 14:48:15.021209 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0620 14:48:15.199346 (+178137us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55346: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":7131,"thread_start_us":6992,"threads_started":1}
W20260620 14:48:15.199898 8871 connection.cc:535] client connection to 127.7.222.252:36651 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 14:48:15.199975 10470 negotiation.cc:337] Failed RPC negotiation. Trace:
0620 14:48:15.014199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44490 (local address 127.7.222.193:33821)
0620 14:48:15.020357 (+ 6158us) server_negotiation.cc:206] Beginning negotiation
0620 14:48:15.020363 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0620 14:48:15.199365 (+179002us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44490: BlockingRecv error: recv got EOF from 127.0.0.1:44490 (error 108)
Metrics: {"server-negotiator.queue_time_us":6041,"thread_start_us":5934,"threads_started":1}
W20260620 14:48:15.200285 8735 connection.cc:535] client connection to 127.7.222.252:36651 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 14:48:15.200732 8990 connection.cc:535] client connection to 127.7.222.252:36651 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260620 14:48:15.201450 8990 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.7.222.252:36651)
W20260620 14:48:15.201728 8990 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.7.222.252:36651)
W20260620 14:48:15.202579 8990 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.7.222.252:36651)
W20260620 14:48:15.202894 8990 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.7.222.252:36651)
I20260620 14:48:15.503664 10452 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 61512e6d316d4d3a998e52511a0bba7a)
I20260620 14:48:15.503851 10452 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:15.504498 10452 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:48:15.506764 10350 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
W20260620 14:48:15.506953 10347 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:48:15.507102 10347 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:48:15.507351 10452 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 14:48:15.759740 10477 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:48:15.759967 10477 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:48:15.760666 10477 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:48:15.761691 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:48:15.761938 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:48:15.762051 8596 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:48:15.762308 10477 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:48:15.858505 8059 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task9VKlbC/build/asan/bin/kudu pid 10327
I20260620 14:48:15.870935 10393 generic_service.cc:196] Checking for leaks (request via RPC)
I20260620 14:48:15.984442 8059 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9VKlbC/build/asan/bin/kudu with pid 10327
I20260620 14:48:16.740065 8059 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9VKlbC/build/asan/bin/kudu
/tmp/dist-test-task9VKlbC/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.222.253:34209
--webserver_interface=127.7.222.253
--webserver_port=40901
--builtin_ntp_servers=127.7.222.212:42755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--hive_metastore_uris=thrift://127.0.0.1:42797
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260620 14:48:17.090556 10496 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260620 14:48:17.090924 10496 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260620 14:48:17.091074 10496 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260620 14:48:17.098711 10496 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260620 14:48:17.098841 10496 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260620 14:48:17.098915 10496 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260620 14:48:17.099010 10496 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260620 14:48:17.108899 10496 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.222.212:42755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:42797
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.222.253:34209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.222.253
--webserver_port=40901
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 20 Jun 2026 13:41:20 UTC on ccycloud.quasar-vdagoi.root.comops.site
build id 4457462
ASAN enabled
I20260620 14:48:17.110280 10496 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 14:48:17.112067 10496 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 14:48:17.124821 10507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:48:17.124791 10510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 14:48:17.124850 10508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 14:48:17.126205 10496 server_base.cc:1034] running on GCE node
I20260620 14:48:17.127034 10496 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260620 14:48:17.128665 10496 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260620 14:48:17.129930 10496 hybrid_clock.cc:648] HybridClock initialized: now 1781966897129864 us; error 47 us; skew 500 ppm
I20260620 14:48:17.130287 10496 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260620 14:48:17.132638 10496 webserver.cc:460] Webserver started at http://127.7.222.253:40901/ using document root <none> and password file <none>
I20260620 14:48:17.133391 10496 fs_manager.cc:359] Metadata directory not provided
I20260620 14:48:17.133540 10496 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 14:48:17.138827 10496 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260620 14:48:17.142400 10516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260620 14:48:17.143791 10496 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260620 14:48:17.143985 10496 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data,/tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
uuid: "caa9dcf251944f7d97f4ed7f3d83af44"
format_stamp: "Formatted at 2026-06-20 14:47:46 on dist-test-slave-c599"
I20260620 14:48:17.145066 10496 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 14:48:17.176954 10496 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260620 14:48:17.178033 10496 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 14:48:17.178354 10496 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 14:48:17.198630 10496 rpc_server.cc:307] RPC server started. Bound to: 127.7.222.253:34209
I20260620 14:48:17.198654 10567 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.222.253:34209 every 8 connection(s)
I20260620 14:48:17.200227 10496 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9VKlbC/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781966851491921-8059-0/minicluster-data/master-1/data/info.pb
I20260620 14:48:17.207834 10568 sys_catalog.cc:263] Verifying existing consensus state
I20260620 14:48:17.209156 8059 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9VKlbC/build/asan/bin/kudu as pid 10496
I20260620 14:48:17.212553 10568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Bootstrap starting.
I20260620 14:48:17.232844 10568 log.cc:824] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Log is configured to *not* fsync() on all Append() calls
I20260620 14:48:17.313681 10568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Bootstrap replayed 1/1 log segments. Stats: ops{read=111 overwritten=0 applied=111 ignored=0} inserts{seen=77 ignored=0} mutations{seen=99 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 14:48:17.314222 10568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: Bootstrap complete.
I20260620 14:48:17.322073 10568 raft_consensus.cc:348] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:17.322914 10568 raft_consensus.cc:729] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa9dcf251944f7d97f4ed7f3d83af44, State: Initialized, Role: FOLLOWER
I20260620 14:48:17.323536 10568 consensus_queue.cc:260] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 111, Last appended: 7.111, Last appended by leader: 111, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:17.324282 10572 sys_catalog.cc:455] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } } }
I20260620 14:48:17.324640 10572 sys_catalog.cc:458] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: This master's current role is: FOLLOWER
I20260620 14:48:17.325449 10568 sys_catalog.cc:564] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 14:48:17.351284 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:48:17.367980 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:48:17.370122 10587 catalog_manager.cc:1259] Loaded cluster ID: 700994c053c643c896af12c77a108604
I20260620 14:48:17.370239 10587 catalog_manager.cc:1552] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: loading cluster ID for follower catalog manager: success
I20260620 14:48:17.374153 10587 catalog_manager.cc:1574] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: acquiring CA information for follower catalog manager: success
I20260620 14:48:17.378159 10587 catalog_manager.cc:1602] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260620 14:48:17.514039 8709 heartbeater.cc:347] Connected to a master server at 127.7.222.253:34209
I20260620 14:48:17.518184 10533 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" instance_seqno: 1781966867942712) as {username='slave'} at 127.7.222.193:33005; Asking this server to re-register.
I20260620 14:48:17.519030 8709 heartbeater.cc:464] Registering TS with master...
I20260620 14:48:17.521108 10533 ts_manager.cc:194] Registered new tserver with Master: c0e6c57ab91e42bf9be3739c816916c0 (127.7.222.193:33821)
W20260620 14:48:17.528528 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 11: this message will repeat every 5th retry.
W20260620 14:48:17.572319 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 11: this message will repeat every 5th retry.
I20260620 14:48:17.594832 8847 heartbeater.cc:347] Connected to a master server at 127.7.222.253:34209
I20260620 14:48:17.596712 10533 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "36236dd5bd604ba2819038e525a3790c" instance_seqno: 1781966868431821) as {username='slave'} at 127.7.222.194:38209; Asking this server to re-register.
I20260620 14:48:17.597404 8847 heartbeater.cc:464] Registering TS with master...
I20260620 14:48:17.598819 10533 ts_manager.cc:194] Registered new tserver with Master: 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
I20260620 14:48:17.628615 8982 heartbeater.cc:347] Connected to a master server at 127.7.222.253:34209
I20260620 14:48:17.630223 10533 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6c99207e35f8463292d71c371c9546b4" instance_seqno: 1781966868961030) as {username='slave'} at 127.7.222.195:50403; Asking this server to re-register.
I20260620 14:48:17.630784 8982 heartbeater.cc:464] Registering TS with master...
I20260620 14:48:17.632208 10533 ts_manager.cc:194] Registered new tserver with Master: 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
I20260620 14:48:17.814777 10590 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:48:17.815065 10590 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:48:17.815796 10590 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:48:17.816772 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:48:17.816980 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:48:17.817126 8596 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:48:17.817386 10590 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:48:17.927811 10593 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:17.928211 10593 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:17.930397 10593 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:48:17.931371 10517 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:48:17.933616 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
W20260620 14:48:17.933856 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:48:17.933991 10517 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:48:17.934316 10593 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 14:48:18.468824 10598 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:18.469031 10598 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:18.469764 10598 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:48:18.471952 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:48:18.472148 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:48:18.472277 10520 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:48:18.472499 10598 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 14:48:19.271615 10610 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:19.271857 10610 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:19.272605 10610 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:48:19.274849 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
W20260620 14:48:19.275084 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:48:19.275231 10517 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:48:19.275497 10610 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 14:48:19.587929 8059 master-stress-test.cc:578] Killing test thread 1/25
I20260620 14:48:19.921623 10615 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:48:19.921902 10615 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:48:19.922501 10615 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:48:19.923162 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:48:19.923403 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:48:19.923561 8596 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:48:19.923797 10615 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:48:20.545955 10620 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:20.546192 10620 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:20.546972 10620 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:48:20.549157 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
W20260620 14:48:20.549350 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:48:20.549474 10517 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:48:20.549685 10620 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 14:48:22.370402 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:48:22.370630 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:48:22.446852 10635 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:22.447085 10635 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:22.447868 10635 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:48:22.450067 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:48:22.450289 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:48:22.450426 10520 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:48:22.450683 10635 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 14:48:25.581473 10654 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:25.581688 10654 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:25.582394 10654 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:48:25.583400 10517 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20260620 14:48:25.584807 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:48:25.585007 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:48:25.585168 10520 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:48:25.585502 10654 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 14:48:26.119253 10661 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:48:26.119508 10661 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:48:26.121006 10661 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:48:26.121388 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:48:26.121608 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:48:26.121774 8596 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:48:26.122097 10661 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:48:26.759378 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 16: this message will repeat every 5th retry.
I20260620 14:48:27.372341 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:48:27.372515 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 14:48:28.706988 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 16: this message will repeat every 5th retry.
I20260620 14:48:29.135898 10684 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:29.136089 10684 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:29.136720 10684 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:48:29.139178 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:48:29.139366 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:48:29.139531 10520 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:48:29.139783 10684 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 14:48:32.373764 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:48:32.373944 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:48:34.071125 10717 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:48:34.071370 10717 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:48:34.072206 10717 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:48:34.073377 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:48:34.073753 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:48:34.073901 8598 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:48:34.074172 10717 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:48:34.811497 10722 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:34.811728 10722 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:34.812431 10722 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:48:34.813514 10517 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260620 14:48:34.814822 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
W20260620 14:48:34.815059 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:48:34.815212 10517 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:48:34.815522 10722 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 14:48:35.995261 10726 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:48:35.995520 10726 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:48:35.996236 10726 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:48:35.997262 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:48:35.997416 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:48:35.997534 8596 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:48:35.997799 10726 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:48:36.534844 10726 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:48:36.535034 10726 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:48:36.535718 10726 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:48:36.536734 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:48:36.536957 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:48:36.537102 8598 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:48:36.537381 10726 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:48:36.863278 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 21: this message will repeat every 5th retry.
I20260620 14:48:37.375447 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:48:37.375617 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 14:48:39.050681 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 21: this message will repeat every 5th retry.
I20260620 14:48:42.377486 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:48:42.377674 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:48:44.752723 10784 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:48:44.752985 10784 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:48:44.753602 10784 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:48:44.754660 10520 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 14:48:44.756203 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
W20260620 14:48:44.756357 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:48:44.756479 10517 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:48:44.756717 10784 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260620 14:48:46.507689 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 26: this message will repeat every 5th retry.
I20260620 14:48:47.379074 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:48:47.379233 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:48:48.732331 10810 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:48:48.732551 10810 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:48:48.733372 10810 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:48:48.734409 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:48:48.734611 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:48:48.734743 8596 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:48:48.735004 10810 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:48:48.783258 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 26: this message will repeat every 5th retry.
W20260620 14:48:49.641625 8846 heartbeater.cc:644] Failed to heartbeat to 127.7.222.254:39515 (102 consecutive failures): Network error: Failed to ping master at 127.7.222.254:39515: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:48:49.681818 8981 heartbeater.cc:644] Failed to heartbeat to 127.7.222.254:39515 (106 consecutive failures): Network error: Failed to ping master at 127.7.222.254:39515: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:48:49.777837 8708 heartbeater.cc:644] Failed to heartbeat to 127.7.222.254:39515 (150 consecutive failures): Network error: Failed to ping master at 127.7.222.254:39515: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:48:51.251997 10821 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:48:51.252188 10821 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:48:51.252950 10821 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:48:51.253931 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:48:51.254112 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:48:51.254221 8598 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:48:51.254443 10821 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:48:52.380837 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:48:52.381102 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:48:55.763464 10853 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:48:55.763660 10853 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:48:55.764374 10853 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:48:55.765424 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:48:55.765609 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:48:55.765739 8598 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:48:55.765980 10853 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:48:57.037362 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 31: this message will repeat every 5th retry.
I20260620 14:48:57.293063 10860 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:48:57.293349 10860 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:48:57.294149 10860 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:48:57.295002 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:48:57.295154 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:48:57.295332 8596 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:48:57.295574 10860 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:48:57.382707 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:48:57.382890 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 14:48:58.419188 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 31: this message will repeat every 5th retry.
I20260620 14:48:59.271063 10873 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:48:59.271385 10873 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:48:59.272167 10873 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:48:59.273118 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:48:59.273381 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:48:59.273554 8598 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:48:59.273814 10873 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:49:02.384459 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:49:02.384635 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:49:02.892496 10899 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:49:02.892735 10899 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:49:02.893621 10899 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:49:02.894860 10520 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 14:49:02.895967 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:49:02.896145 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:49:02.896299 10520 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:49:02.896535 10899 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 14:49:04.366789 10909 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:49:04.367015 10909 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:49:04.367874 10909 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:49:04.368788 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:49:04.368947 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:49:04.369091 8596 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:49:04.369407 10909 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:49:07.151775 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 36: this message will repeat every 5th retry.
I20260620 14:49:07.386197 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:49:07.386466 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 14:49:07.691658 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 36: this message will repeat every 5th retry.
I20260620 14:49:08.846228 10938 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:49:08.846405 10938 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:49:08.847021 10938 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:49:08.847883 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:49:08.848083 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:49:08.848201 8598 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:49:08.848398 10938 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:49:09.294637 10947 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:49:09.294879 10947 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:49:09.295727 10947 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:49:09.296661 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:49:09.296864 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:49:09.297413 8596 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:49:09.297719 10947 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:49:10.140870 10953 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:49:10.141134 10953 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:49:10.141882 10953 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:49:10.143352 10517 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 14:49:10.144611 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
W20260620 14:49:10.144795 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:49:10.144969 10517 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:49:10.145260 10953 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 14:49:11.720857 10963 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:49:11.721042 10963 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:49:11.721698 10963 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:49:11.723845 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
W20260620 14:49:11.724040 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:49:11.724164 10517 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:49:11.724370 10963 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 14:49:12.393152 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:49:12.393357 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:49:16.597034 10991 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:49:16.597275 10991 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:49:16.598163 10991 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:49:16.598938 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:49:16.599139 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:49:16.599280 8596 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:49:16.599540 10991 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:49:17.176975 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 41: this message will repeat every 5th retry.
W20260620 14:49:17.374373 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 41: this message will repeat every 5th retry.
I20260620 14:49:17.394649 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:49:17.394827 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:49:19.231292 11016 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:49:19.231550 11016 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:49:19.232247 11016 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:49:19.233335 10517 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260620 14:49:19.234967 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
W20260620 14:49:19.235167 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:49:19.235328 10517 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:49:19.235595 11016 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 14:49:19.327497 11015 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:49:19.327764 11015 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:49:19.328526 11015 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:49:19.329468 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:49:19.329661 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:49:19.329850 8596 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:49:19.330202 11015 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:49:22.396322 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:49:22.396520 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:49:22.655845 11031 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:49:22.656057 11031 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:49:22.657151 11031 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:49:22.657975 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:49:22.658126 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:49:22.658260 8598 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:49:22.658540 11031 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:49:26.375759 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 46: this message will repeat every 5th retry.
I20260620 14:49:27.398219 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:49:27.398458 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 14:49:27.620323 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 46: this message will repeat every 5th retry.
I20260620 14:49:32.399863 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:49:32.400051 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:49:32.470036 11082 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:49:32.470214 11082 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:49:32.470937 11082 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:49:32.471870 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:49:32.472057 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:49:32.472250 8596 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:49:32.472525 11082 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:49:32.782435 11089 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:49:32.782655 11089 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:49:32.783443 11089 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:49:32.784283 10517 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 14:49:32.785665 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:49:32.785847 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:49:32.785984 10520 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:49:32.786229 11089 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 14:49:34.865633 11106 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:49:34.865852 11106 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:49:34.866637 11106 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:49:34.867492 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:49:34.867658 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:49:34.867821 8596 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:49:34.868522 11106 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:49:36.960531 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 51: this message will repeat every 5th retry.
I20260620 14:49:37.401484 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:49:37.401645 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 14:49:38.320451 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 51: this message will repeat every 5th retry.
I20260620 14:49:38.427203 11126 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:49:38.427420 11126 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:49:38.428383 11126 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:49:38.429387 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:49:38.429603 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:49:38.429760 8596 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:49:38.430018 11126 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:49:39.924700 11131 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:49:39.924955 11131 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:49:39.925628 11131 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:49:39.926859 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:49:39.927068 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:49:39.927255 8598 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:49:39.927526 11131 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:49:42.403090 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:49:42.403280 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:49:42.996240 11150 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:49:42.996466 11150 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:49:42.997179 11150 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:49:42.998029 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:49:42.998183 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:49:42.998289 8598 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:49:42.998530 11150 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:49:45.894613 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 56: this message will repeat every 5th retry.
I20260620 14:49:47.392377 11180 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:49:47.392643 11180 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:49:47.393560 11180 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:49:47.394861 10517 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 14:49:47.396180 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:49:47.396421 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:49:47.396524 10520 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:49:47.396731 11180 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 14:49:47.404192 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:49:47.404347 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 14:49:48.435441 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 56: this message will repeat every 5th retry.
I20260620 14:49:48.471237 11187 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:49:48.471444 11187 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:49:48.472134 11187 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:49:48.473002 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:49:48.473140 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:49:48.473326 8598 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:49:48.473577 11187 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:49:49.142993 11194 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:49:49.143265 11194 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:49:49.143965 11194 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:49:49.146438 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:49:49.146625 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:49:49.146755 10520 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:49:49.146998 11194 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260620 14:49:49.790908 8846 heartbeater.cc:644] Failed to heartbeat to 127.7.222.254:39515 (222 consecutive failures): Network error: Failed to ping master at 127.7.222.254:39515: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:49:49.825618 8981 heartbeater.cc:644] Failed to heartbeat to 127.7.222.254:39515 (226 consecutive failures): Network error: Failed to ping master at 127.7.222.254:39515: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:49:49.982465 11200 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:49:49.982662 11200 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:49:49.983748 11200 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:49:49.984628 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:49:49.988837 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:49:49.989003 8598 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:49:49.989257 11200 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:49:50.129792 8707 heartbeater.cc:644] Failed to heartbeat to 127.7.222.252:36651 (290 consecutive failures): Network error: Failed to ping master at 127.7.222.252:36651: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:49:52.405867 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:49:52.406095 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:49:53.280484 11224 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:49:53.280789 11224 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:49:53.281574 11224 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:49:53.282833 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:49:53.283017 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:49:53.283146 8596 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:49:53.283380 11224 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:49:55.116844 11235 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:49:55.117060 11235 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:49:55.117761 11235 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:49:55.119014 10520 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260620 14:49:55.120810 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:49:55.121042 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:49:55.121183 10520 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:49:55.121469 11235 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260620 14:49:56.147228 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 61: this message will repeat every 5th retry.
I20260620 14:49:57.407559 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:49:57.407763 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:49:57.805162 11248 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:49:57.805467 11248 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:49:57.806421 11248 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:49:57.807287 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:49:57.807543 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:49:57.807682 8598 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:49:57.807993 11248 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:49:59.232295 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 61: this message will repeat every 5th retry.
I20260620 14:50:02.409459 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:50:02.409629 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 14:50:06.368251 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 66: this message will repeat every 5th retry.
I20260620 14:50:07.411362 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:50:07.411607 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 14:50:09.058118 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 66: this message will repeat every 5th retry.
I20260620 14:50:09.394868 11322 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:50:09.395103 11322 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:50:09.395879 11322 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:50:09.397053 10517 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 14:50:09.398144 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
W20260620 14:50:09.398315 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:50:09.398468 10517 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:50:09.398711 11322 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 14:50:09.476037 11320 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:50:09.476295 11320 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:50:09.476986 11320 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:50:09.478037 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:50:09.478209 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:50:09.478317 8598 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:50:09.478564 11320 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:50:11.875589 11320 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:50:11.875797 11320 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:50:11.876443 11320 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:50:11.877549 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:50:11.877736 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:50:11.877876 8596 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:50:11.878168 11320 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:50:12.063046 11340 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:50:12.063408 11340 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:50:12.064083 11340 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:50:12.064939 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:50:12.065145 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:50:12.065320 8598 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:50:12.065590 11340 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:50:12.413075 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:50:12.413256 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 14:50:16.799396 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 71: this message will repeat every 5th retry.
I20260620 14:50:17.351842 10522 maintenance_manager.cc:419] P caa9dcf251944f7d97f4ed7f3d83af44: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033341
I20260620 14:50:17.400942 10521 maintenance_manager.cc:643] P caa9dcf251944f7d97f4ed7f3d83af44: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.048s user 0.033s sys 0.000s Metrics: {"bytes_written":25842,"cfile_init":1,"dirs.queue_time_us":480,"dirs.run_cpu_time_us":206,"dirs.run_wall_time_us":710,"drs_written":1,"lbm_read_time_us":87,"lbm_reads_lt_1ms":4,"lbm_write_time_us":681,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":68,"thread_start_us":601,"threads_started":2,"wal-append.queue_time_us":443}
I20260620 14:50:17.402081 10522 maintenance_manager.cc:419] P caa9dcf251944f7d97f4ed7f3d83af44: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 4436 bytes on disk
I20260620 14:50:17.402779 10521 maintenance_manager.cc:643] P caa9dcf251944f7d97f4ed7f3d83af44: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":68,"lbm_reads_lt_1ms":4}
I20260620 14:50:17.414857 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:50:17.415017 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 14:50:18.678226 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 71: this message will repeat every 5th retry.
I20260620 14:50:20.804991 11396 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:50:20.805265 11396 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:50:20.805951 11396 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:50:20.806991 10517 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 14:50:20.808322 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:50:20.808640 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:50:20.808787 10520 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:50:20.809057 11396 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 14:50:22.416524 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:50:22.416703 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:50:22.622550 11406 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:50:22.622803 11406 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:50:22.623610 11406 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:50:22.624718 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:50:22.625008 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:50:22.625178 8596 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:50:22.625451 11406 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:50:22.823014 11406 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:50:22.823216 11406 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:50:22.823895 11406 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:50:22.824913 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:50:22.825071 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:50:22.825292 8596 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:50:22.825593 11406 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:50:23.747149 11422 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:50:23.747359 11422 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:50:23.748054 11422 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:50:23.748930 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:50:23.749188 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:50:23.749329 8598 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:50:23.749598 11422 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:50:27.073952 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 76: this message will repeat every 5th retry.
I20260620 14:50:27.418200 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:50:27.418433 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:50:27.517903 11441 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:50:27.518138 11441 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:50:27.518862 11441 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:50:27.519865 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:50:27.520040 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:50:27.520241 8596 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:50:27.520556 11441 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:50:28.897081 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 76: this message will repeat every 5th retry.
I20260620 14:50:32.420068 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:50:32.420303 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:50:34.523708 11532 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:50:34.523883 11532 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:50:34.524524 11532 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:50:34.525765 10517 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 14:50:34.527379 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
W20260620 14:50:34.527544 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:50:34.527684 10517 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:50:34.527941 11532 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260620 14:50:36.821887 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 81: this message will repeat every 5th retry.
I20260620 14:50:37.424286 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:50:37.424479 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 14:50:39.391398 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 81: this message will repeat every 5th retry.
I20260620 14:50:40.313284 11580 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:50:40.313455 11580 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:50:40.314327 11580 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:50:40.315182 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:50:40.315313 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:50:40.315404 8596 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:50:40.315644 11580 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:50:41.430047 11599 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:50:41.430300 11599 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:50:41.431080 11599 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:50:41.431910 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:50:41.432101 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:50:41.432214 8596 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:50:41.432487 11599 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:50:42.426225 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:50:42.426450 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:50:44.079758 11618 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:50:44.080010 11618 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:50:44.081053 11618 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:50:44.081856 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:50:44.082041 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:50:44.082178 8596 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:50:44.082408 11618 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:50:46.867074 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 86: this message will repeat every 5th retry.
I20260620 14:50:47.428027 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:50:47.428226 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:50:48.482441 11663 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:50:48.482684 11663 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:50:48.483345 11663 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:50:48.484337 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:50:48.484504 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:50:48.484644 8598 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:50:48.484926 11663 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:50:48.875587 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 86: this message will repeat every 5th retry.
W20260620 14:50:49.935719 8846 heartbeater.cc:644] Failed to heartbeat to 127.7.222.254:39515 (342 consecutive failures): Network error: Failed to ping master at 127.7.222.254:39515: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:50:49.967973 8981 heartbeater.cc:644] Failed to heartbeat to 127.7.222.254:39515 (346 consecutive failures): Network error: Failed to ping master at 127.7.222.254:39515: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:50:50.445295 8708 heartbeater.cc:644] Failed to heartbeat to 127.7.222.254:39515 (517 consecutive failures): Network error: Failed to ping master at 127.7.222.254:39515: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:50:51.073860 11696 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:50:51.074100 11696 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:50:51.075008 11696 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:50:51.076162 10520 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 14:50:51.077699 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
W20260620 14:50:51.077888 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:50:51.078080 10517 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:50:51.078323 11696 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 14:50:52.429797 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:50:52.429977 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:50:53.857864 11726 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:50:53.858031 11726 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:50:53.858775 11726 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:50:53.859572 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:50:53.859771 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:50:53.859944 8598 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:50:53.860193 11726 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:50:56.178438 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 91: this message will repeat every 5th retry.
I20260620 14:50:57.431617 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:50:57.431819 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:50:58.207756 11758 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:50:58.207952 11758 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:50:58.208791 11758 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:50:58.210247 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:50:58.210489 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:50:58.210585 8596 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:50:58.210807 11758 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:50:59.558755 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 91: this message will repeat every 5th retry.
I20260620 14:51:00.664573 11791 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:51:00.664849 11791 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:51:00.665637 11791 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:51:00.666317 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:51:00.666505 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:51:00.666623 8596 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:51:00.666883 11791 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:51:02.433320 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:51:02.433499 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:51:03.217680 11814 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:51:03.217903 11814 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:51:03.218686 11814 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:51:03.219900 10520 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 14:51:03.221289 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
W20260620 14:51:03.221508 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:51:03.221649 10517 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:51:03.221900 11814 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260620 14:51:06.142745 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 96: this message will repeat every 5th retry.
I20260620 14:51:07.435247 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:51:07.435474 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 14:51:10.002764 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 96: this message will repeat every 5th retry.
I20260620 14:51:12.437263 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:51:12.437460 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:51:12.691027 11916 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:51:12.691206 11916 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:51:12.691970 11916 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:51:12.693080 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:51:12.693308 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:51:12.693423 8596 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:51:12.693672 11916 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:51:13.576362 11928 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:51:13.576589 11928 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:51:13.577294 11928 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:51:13.578517 10520 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 14:51:13.578541 10517 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:51:13.580484 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:51:13.580829 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:51:13.580981 10520 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:51:13.581243 11928 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260620 14:51:15.957131 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 101: this message will repeat every 5th retry.
I20260620 14:51:17.438885 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:51:17.439424 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:51:17.853953 11971 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:51:17.854139 11971 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:51:17.855049 11971 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:51:17.855890 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:51:17.856130 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:51:17.856237 8596 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:51:17.856534 11971 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:51:18.057767 11975 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:51:18.058109 11975 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:51:18.058876 11975 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:51:18.061203 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
W20260620 14:51:18.061430 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:51:18.061533 10517 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:51:18.061743 11975 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 14:51:19.395401 11961 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:51:19.395759 11961 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:51:19.396510 11961 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:51:19.397521 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:51:19.397637 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:51:19.397758 8598 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:51:19.397994 11961 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:51:19.487478 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 101: this message will repeat every 5th retry.
I20260620 14:51:20.341472 11995 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:51:20.341662 11995 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:51:20.342250 11995 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:51:20.343135 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:51:20.343350 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:51:20.343495 8596 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:51:20.343727 11995 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:51:21.201318 12006 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:51:21.201539 12006 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:51:21.202373 12006 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:51:21.203405 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:51:21.203553 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:51:21.203640 8596 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:51:21.203841 12006 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:51:22.441166 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:51:22.441417 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:51:22.989341 12027 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:51:22.989513 12027 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:51:22.990253 12027 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:51:22.991214 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:51:22.991750 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:51:22.991854 8596 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:51:22.992442 12028 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:51:25.855851 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 106: this message will repeat every 5th retry.
I20260620 14:51:27.443110 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:51:27.443274 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 14:51:29.377714 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 106: this message will repeat every 5th retry.
I20260620 14:51:29.812490 12082 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:51:29.812786 12082 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:51:29.813472 12082 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:51:29.814585 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:51:29.814821 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:51:29.814985 8596 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:51:29.815256 12082 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:51:30.662839 12102 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:51:30.663033 12102 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:51:30.663671 12102 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:51:30.664839 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:51:30.665045 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:51:30.665158 8596 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:51:30.665437 12102 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:51:30.744820 12102 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:51:30.745035 12102 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:51:30.745697 12102 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:51:30.746465 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:51:30.746632 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:51:30.746730 8598 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:51:30.746954 12102 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:51:32.444979 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:51:32.445143 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 14:51:36.239024 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 111: this message will repeat every 5th retry.
I20260620 14:51:37.446678 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:51:37.446883 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:51:37.502036 12165 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:51:37.502314 12165 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:51:37.503407 12165 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:51:37.504017 10517 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111) [suppressed 2 similar messages]
W20260620 14:51:37.505692 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:51:37.505913 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:51:37.506045 10520 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:51:37.506325 12165 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260620 14:51:38.745141 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 111: this message will repeat every 5th retry.
I20260620 14:51:42.448549 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:51:42.448733 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:51:42.476267 12209 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:51:42.476544 12209 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:51:42.477314 12209 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:51:42.479071 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:51:42.479285 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:51:42.479453 10520 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:51:42.479773 12209 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 14:51:42.819032 12186 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:51:42.819291 12186 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:51:42.820160 12186 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:51:42.821007 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:51:42.821177 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:51:42.821311 8596 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:51:42.821620 12186 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:51:44.179965 12186 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:51:44.180186 12186 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:51:44.180877 12186 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:51:44.181821 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:51:44.181968 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:51:44.182126 8598 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:51:44.182374 12186 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:51:45.971114 12234 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:51:45.971313 12234 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:51:45.972069 12234 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:51:45.973037 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:51:45.973193 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:51:45.973310 8596 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:51:45.973496 12234 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:51:46.158695 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 116: this message will repeat every 5th retry.
I20260620 14:51:47.450173 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:51:47.450376 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:51:47.789443 12259 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:51:47.789705 12259 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:51:47.790463 12259 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:51:47.790930 10517 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260620 14:51:47.792292 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:51:47.792438 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:51:47.792616 10520 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:51:47.792902 12259 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 14:51:47.797405 12251 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:51:47.797573 12251 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:51:47.798175 12251 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:51:47.798950 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:51:47.799085 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:51:47.799240 8598 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:51:47.799475 12251 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:51:48.850634 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 116: this message will repeat every 5th retry.
W20260620 14:51:50.076730 8846 heartbeater.cc:644] Failed to heartbeat to 127.7.222.254:39515 (462 consecutive failures): Network error: Failed to ping master at 127.7.222.254:39515: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:51:50.107106 8981 heartbeater.cc:644] Failed to heartbeat to 127.7.222.254:39515 (466 consecutive failures): Network error: Failed to ping master at 127.7.222.254:39515: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:51:50.584544 12290 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:51:50.584774 12290 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:51:50.585520 12290 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:51:50.586441 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:51:50.586601 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:51:50.586726 8596 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:51:50.587019 12290 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:51:50.699554 8707 heartbeater.cc:644] Failed to heartbeat to 127.7.222.252:36651 (663 consecutive failures): Network error: Failed to ping master at 127.7.222.252:36651: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:51:52.452075 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:51:52.452252 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 14:51:55.634527 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 121: this message will repeat every 5th retry.
I20260620 14:51:55.810451 12328 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:51:55.810676 12328 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:51:55.811404 12328 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:51:55.812366 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:51:55.812486 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:51:55.812551 8596 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:51:55.812733 12328 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:51:56.975175 12344 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:51:56.975378 12344 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:51:56.975993 12344 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:51:56.977152 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:51:56.977325 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:51:56.977437 8596 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:51:56.977635 12344 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:51:57.453732 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:51:57.453900 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 14:51:58.912045 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 121: this message will repeat every 5th retry.
I20260620 14:52:01.026531 12384 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:52:01.026785 12384 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:52:01.027552 12384 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:52:01.029080 10517 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 14:52:01.030313 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
W20260620 14:52:01.030511 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:52:01.030612 10517 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:52:01.030879 12384 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 14:52:02.455349 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:52:02.455523 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:52:03.748665 12412 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:52:03.748904 12412 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:52:03.749672 12412 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:52:03.750550 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:52:03.750694 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:52:03.750803 8596 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:52:03.751004 12412 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:52:05.514658 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 126: this message will repeat every 5th retry.
I20260620 14:52:07.457204 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:52:07.457432 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 14:52:09.131906 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 126: this message will repeat every 5th retry.
I20260620 14:52:12.458842 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:52:12.459002 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:52:14.237788 12502 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:52:14.238016 12502 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:52:14.238834 12502 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:52:14.239777 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:52:14.240006 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:52:14.240118 8598 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:52:14.240377 12502 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:52:15.419422 12510 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:52:15.419643 12510 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:52:15.420428 12510 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:52:15.421407 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:52:15.421537 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:52:15.421684 8598 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:52:15.421962 12510 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:52:15.556145 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 131: this message will repeat every 5th retry.
I20260620 14:52:16.146935 12519 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:52:16.147178 12519 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:52:16.148047 12519 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:52:16.149282 10517 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 14:52:16.150825 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:52:16.151031 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:52:16.151163 10520 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:52:16.151396 12519 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 14:52:17.460659 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:52:17.460947 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:52:18.621776 12531 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:52:18.621953 12531 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:52:18.622634 12531 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:52:18.623415 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:52:18.623536 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:52:18.623617 8598 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:52:18.623787 12531 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:52:18.982997 12531 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:52:18.983170 12531 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:52:18.983899 12531 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:52:18.984798 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:52:18.984933 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:52:18.985070 8598 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:52:18.985352 12531 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:52:19.404219 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 131: this message will repeat every 5th retry.
I20260620 14:52:22.462513 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:52:22.462682 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:52:23.406857 12584 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:52:23.407068 12584 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:52:23.407796 12584 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:52:23.409216 10517 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 14:52:23.410527 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:52:23.410689 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:52:23.410833 10520 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:52:23.411110 12584 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260620 14:52:24.626400 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 136: this message will repeat every 5th retry.
I20260620 14:52:26.010587 12607 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:52:26.010779 12607 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:52:26.011598 12607 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:52:26.012543 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:52:26.012784 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:52:26.012914 8598 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:52:26.013168 12607 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:52:27.242426 12607 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:52:27.242640 12607 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:52:27.243309 12607 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:52:27.244323 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:52:27.244495 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:52:27.244633 8598 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:52:27.244879 12607 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:52:27.464262 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:52:27.464434 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:52:27.740073 12607 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:52:27.740243 12607 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:52:27.740710 12607 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:52:27.741568 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:52:27.741698 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:52:27.741788 8598 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:52:27.741994 12607 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:52:30.043437 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 136: this message will repeat every 5th retry.
I20260620 14:52:31.225241 12633 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:52:31.225448 12633 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:52:31.226104 12633 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:52:31.226989 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:52:31.227099 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:52:31.227232 8596 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:52:31.227524 12633 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:52:31.276656 12633 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:52:31.276860 12633 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:52:31.277437 12633 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:52:31.278273 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:52:31.278577 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:52:31.278671 8596 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:52:31.278931 12633 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:52:32.466017 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:52:32.466188 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 14:52:34.686352 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 141: this message will repeat every 5th retry.
I20260620 14:52:36.545879 12690 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:52:36.546131 12690 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:52:36.546988 12690 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:52:36.547962 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:52:36.548151 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:52:36.548269 8598 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:52:36.548487 12690 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:52:37.467708 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:52:37.467952 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:52:38.017704 12713 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:52:38.017917 12713 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:52:38.018603 12713 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:52:38.019744 10520 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 14:52:38.021075 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
W20260620 14:52:38.021366 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:52:38.021457 10517 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:52:38.021749 12713 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260620 14:52:40.370712 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 141: this message will repeat every 5th retry.
I20260620 14:52:42.469344 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:52:42.469504 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 14:52:44.772992 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 146: this message will repeat every 5th retry.
I20260620 14:52:45.594655 12776 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:52:45.594802 12776 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:52:45.595326 12776 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:52:45.596163 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:52:45.596294 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:52:45.596382 8596 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:52:45.596652 12776 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:52:46.409888 12781 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:52:46.410094 12781 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:52:46.410709 12781 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:52:46.411464 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:52:46.411649 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:52:46.411770 8596 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:52:46.412027 12781 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:52:47.471271 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:52:47.471463 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:52:47.984014 12802 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:52:47.984186 12802 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:52:47.984951 12802 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:52:47.986022 10517 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 14:52:47.987166 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
W20260620 14:52:47.987378 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:52:47.987532 10517 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:52:47.987829 12802 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 14:52:48.034940 12796 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:52:48.035117 12796 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:52:48.035697 12796 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:52:48.036571 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:52:48.036726 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:52:48.036899 8598 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:52:48.037181 12796 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:52:50.215987 8846 heartbeater.cc:644] Failed to heartbeat to 127.7.222.254:39515 (582 consecutive failures): Network error: Failed to ping master at 127.7.222.254:39515: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:52:50.245759 8981 heartbeater.cc:644] Failed to heartbeat to 127.7.222.254:39515 (586 consecutive failures): Network error: Failed to ping master at 127.7.222.254:39515: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:52:50.565733 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 146: this message will repeat every 5th retry.
W20260620 14:52:51.064978 8708 heartbeater.cc:644] Failed to heartbeat to 127.7.222.254:39515 (888 consecutive failures): Network error: Failed to ping master at 127.7.222.254:39515: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:52:51.533058 12832 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:52:51.533237 12832 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:52:51.533996 12832 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:52:51.536077 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:52:51.536257 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:52:51.536424 10520 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:52:51.536684 12832 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 14:52:52.472859 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:52:52.473045 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260620 14:52:55.479734 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 151: this message will repeat every 5th retry.
I20260620 14:52:57.474575 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:52:57.474766 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:52:57.483100 12876 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:52:57.483266 12876 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:52:57.484007 12876 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:52:57.484802 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:52:57.484921 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:52:57.485029 8598 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:52:57.485253 12876 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:53:00.291896 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 151: this message will repeat every 5th retry.
I20260620 14:53:02.476528 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:53:02.476707 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:53:04.653097 12950 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:53:04.653366 12950 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:53:04.654119 12950 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:53:04.655423 10517 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260620 14:53:04.656659 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
W20260620 14:53:04.656849 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
I20260620 14:53:04.657009 10520 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:53:04.657332 12950 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 14:53:05.087070 12948 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:53:05.087283 12948 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:53:05.088107 12948 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:53:05.089195 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:53:05.089349 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:53:05.089520 8596 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:53:05.089795 12948 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:53:05.823895 12960 raft_consensus.cc:482] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:53:05.824101 12960 raft_consensus.cc:504] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } } peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } }
I20260620 14:53:05.824719 12960 leader_election.cc:288] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279), 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159)
W20260620 14:53:05.825556 8598 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
W20260620 14:53:05.825713 8596 leader_election.cc:341] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 77320ec0783e43c2817b0ff16134915e
I20260620 14:53:05.825896 8596 leader_election.cc:302] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:53:05.826154 12960 raft_consensus.cc:2726] T 77320ec0783e43c2817b0ff16134915e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:53:06.284881 8596 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Couldn't send request to peer 6c99207e35f8463292d71c371c9546b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 156: this message will repeat every 5th retry.
I20260620 14:53:06.800046 12969 raft_consensus.cc:482] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:53:06.800272 12969 raft_consensus.cc:504] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:53:06.801052 12969 leader_election.cc:288] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:53:06.801962 8598 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
W20260620 14:53:06.802315 8596 leader_election.cc:341] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: a4552c4e15464f21a10b6c2d83f7ead8
I20260620 14:53:06.802423 8596 leader_election.cc:302] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:53:06.802707 12969 raft_consensus.cc:2726] T a4552c4e15464f21a10b6c2d83f7ead8 P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260620 14:53:07.477988 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:53:07.478175 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:53:09.187110 12993 raft_consensus.cc:482] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c99207e35f8463292d71c371c9546b4)
I20260620 14:53:09.187341 12993 raft_consensus.cc:504] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0e6c57ab91e42bf9be3739c816916c0" member_type: VOTER last_known_addr { host: "127.7.222.193" port: 33821 } } peers { permanent_uuid: "36236dd5bd604ba2819038e525a3790c" member_type: VOTER last_known_addr { host: "127.7.222.194" port: 39159 } } peers { permanent_uuid: "6c99207e35f8463292d71c371c9546b4" member_type: VOTER last_known_addr { host: "127.7.222.195" port: 45279 } }
I20260620 14:53:09.188006 12993 leader_election.cc:288] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159), 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279)
W20260620 14:53:09.188908 8596 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6c99207e35f8463292d71c371c9546b4 (127.7.222.195:45279): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
W20260620 14:53:09.189025 8598 leader_election.cc:341] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Not found: Tablet not found: 493a30104eab4762a3f4ffae3491765e
I20260620 14:53:09.189159 8598 leader_election.cc:302] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0e6c57ab91e42bf9be3739c816916c0; no voters: 36236dd5bd604ba2819038e525a3790c, 6c99207e35f8463292d71c371c9546b4
I20260620 14:53:09.189392 12993 raft_consensus.cc:2726] T 493a30104eab4762a3f4ffae3491765e P c0e6c57ab91e42bf9be3739c816916c0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260620 14:53:10.251401 8598 consensus_peers.cc:487] T 1c65081e59334f90839952e5d1eda960 P c0e6c57ab91e42bf9be3739c816916c0 -> Peer 36236dd5bd604ba2819038e525a3790c (127.7.222.194:39159): Couldn't send request to peer 36236dd5bd604ba2819038e525a3790c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c65081e59334f90839952e5d1eda960. This is attempt 156: this message will repeat every 5th retry.
I20260620 14:53:10.846532 13008 raft_consensus.cc:482] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 14:53:10.846796 13008 raft_consensus.cc:504] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd308569015348a7a19ba4a560de6d52" member_type: VOTER last_known_addr { host: "127.7.222.254" port: 39515 } } peers { permanent_uuid: "caa9dcf251944f7d97f4ed7f3d83af44" member_type: VOTER last_known_addr { host: "127.7.222.253" port: 34209 } } peers { permanent_uuid: "61512e6d316d4d3a998e52511a0bba7a" member_type: VOTER last_known_addr { host: "127.7.222.252" port: 36651 } }
I20260620 14:53:10.847508 13008 leader_election.cc:288] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515), 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651)
W20260620 14:53:10.848776 10520 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260620 14:53:10.850054 10520 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 61512e6d316d4d3a998e52511a0bba7a (127.7.222.252:36651): Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
W20260620 14:53:10.850236 10517 leader_election.cc:334] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dd308569015348a7a19ba4a560de6d52 (127.7.222.254:39515): Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111)
I20260620 14:53:10.850390 10517 leader_election.cc:302] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: caa9dcf251944f7d97f4ed7f3d83af44; no voters: 61512e6d316d4d3a998e52511a0bba7a, dd308569015348a7a19ba4a560de6d52
I20260620 14:53:10.850665 13008 raft_consensus.cc:2726] T 00000000000000000000000000000000 P caa9dcf251944f7d97f4ed7f3d83af44 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260620 14:53:12.480242 10496 master_runner.cc:186] Error getting master registration for 127.7.222.254:39515: Network error: Client connection negotiation failed: client connection to 127.7.222.254:39515: connect: Connection refused (error 111),
I20260620 14:53:12.480453 10496 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260620 14:53:15.175309 10522 maintenance_manager.cc:419] P caa9dcf251944f7d97f4ed7f3d83af44: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 4436 bytes on disk
I20260620 14:53:15.181283 10521 maintenance_manager.cc:643] P caa9dcf251944f7d97f4ed7f3d83af44: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.005s user 0.005s sys 0.000s Metrics: {"dirs.queue_time_us":460,"thread_start_us":501,"threads_started":2,"wal-append.queue_time_us":393}
W20260620 14:53:15.614674 8990 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
W20260620 14:53:15.614907 8990 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
W20260620 14:53:15.615038 8990 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
W20260620 14:53:15.615116 8990 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
F20260620 14:53:15.626130 9013 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260620 14:53:15.626200 9017 master-stress-test.cc:392] Check failed: _s.ok() Bad status: F20260620 14:53:15.626168 8996 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: Error creating table default.Table_9d59fa2b31544f17b044945d2a45a612 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260620 14:53:15.626200 9017 master-stress-test.cc:392] Check failed: _s.ok() Bad status: F20260620 14:53:15.626168 8996 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: Error creating table default.Table_9d59fa2b31544f17b044945d2a45a612 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
*** Check failure stack trace: ***
*** Aborted at 1781967195 (unix time) try "date -d @1781967195" if you are using GNU date ***
F20260620 14:53:15.626200 9017 master-stress-test.cc:392] Check failed: _s.ok() Bad status: F20260620 14:53:15.626168 8996 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: Error creating table default.Table_9d59fa2b31544f17b044945d2a45a612 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.627522 9001 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ce174d6c98a242ab9c1ea68d35bd8c28 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260620 14:53:15.626200 9017 master-stress-test.cc:392] Check failed: _s.ok() Bad status: F20260620 14:53:15.626168 8996 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: Error creating table default.Table_9d59fa2b31544f17b044945d2a45a612 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.627522 9001 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ce174d6c98a242ab9c1ea68d35bd8c28 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628762 9000 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fdfd2b5f110441cb9e549b5eba106701 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260620 14:53:15.626200 9017 master-stress-test.cc:392] Check failed: _s.ok() Bad status: F20260620 14:53:15.626168 8996 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: Error creating table default.Table_9d59fa2b31544f17b044945d2a45a612 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.627522 9001 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ce174d6c98a242ab9c1ea68d35bd8c28 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628762 9000 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fdfd2b5f110441cb9e549b5eba106701 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628927 9005 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2d00c2dfdbfe428a8de80587e6f6e918 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260620 14:53:15.626200 9017 master-stress-test.cc:392] Check failed: _s.ok() Bad status: F20260620 14:53:15.626168 8996 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: Error creating table default.Table_9d59fa2b31544f17b044945d2a45a612 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.627522 9001 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ce174d6c98a242ab9c1ea68d35bd8c28 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628762 9000 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fdfd2b5f110441cb9e549b5eba106701 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628927 9005 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2d00c2dfdbfe428a8de80587e6f6e918 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629094 9011 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260620 14:53:15.626200 9017 master-stress-test.cc:392] Check failed: _s.ok() Bad status: F20260620 14:53:15.626168 8996 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: Error creating table default.Table_9d59fa2b31544f17b044945d2a45a612 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.627522 9001 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ce174d6c98a242ab9c1ea68d35bd8c28 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628762 9000 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fdfd2b5f110441cb9e549b5eba106701 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628927 9005 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2d00c2dfdbfe428a8de80587e6f6e918 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629094 9011 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629256 9006 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629282 9015 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629558 9018 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260620 14:53:15.629567 9008 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260620 14:53:15.626200 9017 master-stress-test.cc:392] Check failed: _s.ok() Bad status: F20260620 14:53:15.626168 8996 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: Error creating table default.Table_9d59fa2b31544f17b044945d2a45a612 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.627522 9001 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ce174d6c98a242ab9c1ea68d35bd8c28 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628762 9000 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fdfd2b5f110441cb9e549b5eba106701 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628927 9005 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2d00c2dfdbfe428a8de80587e6f6e918 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629094 9011 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629256 9006 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629282 9015 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629558 9018 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260620 14:53:15.629567 9008 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260620 14:53:15.626200 9017 master-stress-test.cc:392] Check failed: _s.ok() Bad status: F20260620 14:53:15.626168 8996 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: Error creating table default.Table_9d59fa2b31544f17b044945d2a45a612 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.627522 9001 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ce174d6c98a242ab9c1ea68d35bd8c28 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628762 9000 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fdfd2b5f110441cb9e549b5eba106701 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628927 9005 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2d00c2dfdbfe428a8de80587e6f6e918 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629094 9011 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629256 9006 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629282 9015 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629558 9018 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260620 14:53:15.629567 9008 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629972 9007 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260620 14:53:15.626200 9017 master-stress-test.cc:392] Check failed: _s.ok() Bad status: F20260620 14:53:15.626168 8996 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: Error creating table default.Table_9d59fa2b31544f17b044945d2a45a612 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.627522 9001 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ce174d6c98a242ab9c1ea68d35bd8c28 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628762 9000 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fdfd2b5f110441cb9e549b5eba106701 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628927 9005 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2d00c2dfdbfe428a8de80587e6f6e918 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629094 9011 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629256 9006 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629282 9015 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629558 9018 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260620 14:53:15.629567 9008 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629972 9007 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.630163 9014 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260620 14:53:15.626200 9017 master-stress-test.cc:392] Check failed: _s.ok() Bad status: F20260620 14:53:15.626168 8996 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: Error creating table default.Table_9d59fa2b31544f17b044945d2a45a612 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.627522 9001 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ce174d6c98a242ab9c1ea68d35bd8c28 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628762 9000 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fdfd2b5f110441cb9e549b5eba106701 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628927 9005 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2d00c2dfdbfe428a8de80587e6f6e918 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629094 9011 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629256 9006 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629282 9015 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629558 9018 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260620 14:53:15.629567 9008 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629972 9007 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.630163 9014 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260620 14:53:15.626200 9017 master-stress-test.cc:392] Check failed: _s.ok() Bad status: F20260620 14:53:15.626168 8996 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: Error creating table default.Table_9d59fa2b31544f17b044945d2a45a612 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.627522 9001 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ce174d6c98a242ab9c1ea68d35bd8c28 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628762 9000 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fdfd2b5f110441cb9e549b5eba106701 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628927 9005 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2d00c2dfdbfe428a8de80587e6f6e918 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629094 9011 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629256 9006 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629282 9015 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629558 9018 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260620 14:53:15.629567 9008 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629972 9007 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.630163 9014 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260620 14:53:15.626200 9017 master-stress-test.cc:392] Check failed: _s.ok() Bad status: F20260620 14:53:15.626168 8996 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: Error creating table default.Table_9d59fa2b31544f17b044945d2a45a612 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.627522 9001 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ce174d6c98a242ab9c1ea68d35bd8c28 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628762 9000 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fdfd2b5f110441cb9e549b5eba106701 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628927 9005 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2d00c2dfdbfe428a8de80587e6f6e918 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629094 9011 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629256 9006 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629282 9015 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629558 9018 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260620 14:53:15.629567 9008 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629972 9007 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.630163 9014 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631304 9019 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260620 14:53:15.626200 9017 master-stress-test.cc:392] Check failed: _s.ok() Bad status: F20260620 14:53:15.626168 8996 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: Error creating table default.Table_9d59fa2b31544f17b044945d2a45a612 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.627522 9001 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ce174d6c98a242ab9c1ea68d35bd8c28 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628762 9000 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fdfd2b5f110441cb9e549b5eba106701 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628927 9005 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2d00c2dfdbfe428a8de80587e6f6e918 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629094 9011 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629256 9006 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629282 9015 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629558 9018 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260620 14:53:15.629567 9008 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629972 9007 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.630163 9014 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631304 9019 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631592 9002 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_96a3abe199c94222aea451130599b401 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260620 14:53:15.626200 9017 master-stress-test.cc:392] Check failed: _s.ok() Bad status: F20260620 14:53:15.626168 8996 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: Error creating table default.Table_9d59fa2b31544f17b044945d2a45a612 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.627522 9001 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ce174d6c98a242ab9c1ea68d35bd8c28 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628762 9000 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fdfd2b5f110441cb9e549b5eba106701 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628927 9005 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2d00c2dfdbfe428a8de80587e6f6e918 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629094 9011 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629256 9006 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629282 9015 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629558 9018 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260620 14:53:15.629567 9008 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629972 9007 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.630163 9014 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631304 9019 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631592 9002 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_96a3abe199c94222aea451130599b401 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631625 9003 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4f7f7c8b2fa84940bcb443efbbded490 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260620 14:53:15.626200 9017 master-stress-test.cc:392] Check failed: _s.ok() Bad status: F20260620 14:53:15.626168 8996 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: Error creating table default.Table_9d59fa2b31544f17b044945d2a45a612 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.627522 9001 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ce174d6c98a242ab9c1ea68d35bd8c28 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628762 9000 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fdfd2b5f110441cb9e549b5eba106701 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628927 9005 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2d00c2dfdbfe428a8de80587e6f6e918 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629094 9011 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629256 9006 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629282 9015 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629558 9018 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260620 14:53:15.629567 9008 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629972 9007 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.630163 9014 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631304 9019 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631592 9002 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_96a3abe199c94222aea451130599b401 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631625 9003 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4f7f7c8b2fa84940bcb443efbbded490 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.632128 9004 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_13f389c96bd0448091e94f5127394533 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260620 14:53:15.626200 9017 master-stress-test.cc:392] Check failed: _s.ok() Bad status: F20260620 14:53:15.626168 8996 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: Error creating table default.Table_9d59fa2b31544f17b044945d2a45a612 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.627522 9001 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ce174d6c98a242ab9c1ea68d35bd8c28 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628762 9000 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fdfd2b5f110441cb9e549b5eba106701 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628927 9005 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2d00c2dfdbfe428a8de80587e6f6e918 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629094 9011 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629256 9006 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629282 9015 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629558 9018 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260620 14:53:15.629567 9008 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629972 9007 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.630163 9014 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631304 9019 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631592 9002 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_96a3abe199c94222aea451130599b401 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631625 9003 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4f7f7c8b2fa84940bcb443efbbded490 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.632128 9004 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_13f389c96bd0448091e94f5127394533 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.632179 8997 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_34a7935bc68a42c3aa8f0c43b09b30a8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260620 14:53:15.626200 9017 master-stress-test.cc:392] Check failed: _s.ok() Bad status: F20260620 14:53:15.626168 8996 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: Error creating table default.Table_9d59fa2b31544f17b044945d2a45a612 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.627522 9001 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ce174d6c98a242ab9c1ea68d35bd8c28 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628762 9000 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fdfd2b5f110441cb9e549b5eba106701 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628927 9005 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2d00c2dfdbfe428a8de80587e6f6e918 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629094 9011 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629256 9006 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629282 9015 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629558 9018 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260620 14:53:15.629567 9008 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629972 9007 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.630163 9014 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631304 9019 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631592 9002 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_96a3abe199c94222aea451130599b401 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631625 9003 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4f7f7c8b2fa84940bcb443efbbded490 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.632128 9004 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_13f389c96bd0448091e94f5127394533 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.632179 8997 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_34a7935bc68a42c3aa8f0c43b09b30a8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.632251 9010 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260620 14:53:15.632184 9012 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260620 14:53:15.626200 9017 master-stress-test.cc:392] Check failed: _s.ok() Bad status: F20260620 14:53:15.626168 8996 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: Error creating table default.Table_9d59fa2b31544f17b044945d2a45a612 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.627522 9001 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ce174d6c98a242ab9c1ea68d35bd8c28 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628762 9000 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fdfd2b5f110441cb9e549b5eba106701 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628927 9005 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2d00c2dfdbfe428a8de80587e6f6e918 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629094 9011 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629256 9006 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629282 9015 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629558 9018 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260620 14:53:15.629567 9008 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629972 9007 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.630163 9014 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631304 9019 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631592 9002 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_96a3abe199c94222aea451130599b401 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631625 9003 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4f7f7c8b2fa84940bcb443efbbded490 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.632128 9004 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_13f389c96bd0448091e94f5127394533 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.632179 8997 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_34a7935bc68a42c3aa8f0c43b09b30a8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.632251 9010 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260620 14:53:15.632184 9012 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
F20260620 14:53:15.626200 9017 master-stress-test.cc:392] Check failed: _s.ok() Bad status: F20260620 14:53:15.626168 8996 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: Error creating table default.Table_9d59fa2b31544f17b044945d2a45a612 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.627522 9001 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ce174d6c98a242ab9c1ea68d35bd8c28 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628762 9000 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fdfd2b5f110441cb9e549b5eba106701 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628927 9005 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2d00c2dfdbfe428a8de80587e6f6e918 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629094 9011 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629256 9006 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629282 9015 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629558 9018 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260620 14:53:15.629567 9008 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629972 9007 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.630163 9014 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631304 9019 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631592 9002 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_96a3abe199c94222aea451130599b401 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631625 9003 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4f7f7c8b2fa84940bcb443efbbded490 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.632128 9004 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_13f389c96bd0448091e94f5127394533 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.632179 8997 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_34a7935bc68a42c3aa8f0c43b09b30a8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.632251 9010 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260620 14:53:15.632184 9012 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.633924 8999 master-stress-test.cc:298] Check failed: _s.ok() Bad status: F20260620 14:53:15.633929 Timed out: Error creating table default.Table_1d5a20c59b2741ca905b63fd9478cf1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111) T*** Check failure stack trace: ***
F20260620 14:53:15.626200 9017 master-stress-test.cc:392] Check failed: _s.ok() Bad status: F20260620 14:53:15.626168 8996 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: Error creating table default.Table_9d59fa2b31544f17b044945d2a45a612 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.627522 9001 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ce174d6c98a242ab9c1ea68d35bd8c28 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628762 9000 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fdfd2b5f110441cb9e549b5eba106701 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628927 9005 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2d00c2dfdbfe428a8de80587e6f6e918 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629094 9011 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629256 9006 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629282 9015 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629558 9018 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260620 14:53:15.629567 9008 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629972 9007 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.630163 9014 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631304 9019 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631592 9002 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_96a3abe199c94222aea451130599b401 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631625 9003 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4f7f7c8b2fa84940bcb443efbbded490 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.632128 9004 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_13f389c96bd0448091e94f5127394533 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.632179 8997 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_34a7935bc68a42c3aa8f0c43b09b30a8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.632251 9010 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260620 14:53:15.632184 9012 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.633924 8999 master-stress-test.cc:298] Check failed: _s.ok() Bad status: F20260620 14:53:15.633929 Timed out: Error creating table default.Table_1d5a20c59b2741ca905b63fd9478cf1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111) Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.633986 *** Check failure stack trace: ***
F20260620 14:53:15.626200 9017 master-stress-test.cc:392] Check failed: _s.ok() Bad status: F20260620 14:53:15.626168 8996 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: Error creating table default.Table_9d59fa2b31544f17b044945d2a45a612 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.627522 9001 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ce174d6c98a242ab9c1ea68d35bd8c28 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628762 9000 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fdfd2b5f110441cb9e549b5eba106701 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628927 9005 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2d00c2dfdbfe428a8de80587e6f6e918 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629094 9011 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629256 9006 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629282 9015 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629558 9018 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260620 14:53:15.629567 9008 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629972 9007 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.630163 9014 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631304 9019 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631592 9002 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_96a3abe199c94222aea451130599b401 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631625 9003 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4f7f7c8b2fa84940bcb443efbbded490 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.632128 9004 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_13f389c96bd0448091e94f5127394533 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.632179 8997 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_34a7935bc68a42c3aa8f0c43b09b30a8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.632251 9010 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260620 14:53:15.632184 9012 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.633924 8999 master-stress-test.cc:298] Check failed: _s.ok() Bad status: F20260620 14:53:15.633929 Timed out: Error creating table default.Table_1d5a20c59b2741ca905b63fd9478cf1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111) Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.633986 9009 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
*** Check failure stack trace: ***
*** SIGABRT (@0x3e800001f7b) received by PID 8059 (TID 0x7f7bf28af700) from PID 8059; stack trace: ***
F20260620 14:53:15.626200 9017 master-stress-test.cc:392] Check failed: _s.ok() Bad status: F20260620 14:53:15.626168 8996 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: Error creating table default.Table_9d59fa2b31544f17b044945d2a45a612 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.627522 9001 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ce174d6c98a242ab9c1ea68d35bd8c28 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628762 9000 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fdfd2b5f110441cb9e549b5eba106701 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628927 9005 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2d00c2dfdbfe428a8de80587e6f6e918 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629094 9011 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629256 9006 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629282 9015 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629558 9018 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260620 14:53:15.629567 9008 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629972 9007 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.630163 9014 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631304 9019 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631592 9002 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_96a3abe199c94222aea451130599b401 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631625 9003 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4f7f7c8b2fa84940bcb443efbbded490 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.632128 9004 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_13f389c96bd0448091e94f5127394533 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.632179 8997 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_34a7935bc68a42c3aa8f0c43b09b30a8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.632251 9010 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260620 14:53:15.632184 9012 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.633924 8999 master-stress-test.cc:298] Check failed: _s.ok() Bad status: F20260620 14:53:15.633929 Timed out: Error creating table default.Table_1d5a20c59b2741ca905b63fd9478cf1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111) Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.633986 9009 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.634414 8998 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_63c7519d9a2a45b980b2d44a70aec200 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260620 14:53:15.626200 9017 master-stress-test.cc:392] Check failed: _s.ok() Bad status: F20260620 14:53:15.626168 8996 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: Error creating table default.Table_9d59fa2b31544f17b044945d2a45a612 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.627522 9001 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_ce174d6c98a242ab9c1ea68d35bd8c28 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628762 9000 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_fdfd2b5f110441cb9e549b5eba106701 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.628927 9005 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2d00c2dfdbfe428a8de80587e6f6e918 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629094 9011 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629256 9006 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629282 9015 master-stress-test.cc:352] Check failed: _s.ok() Bad status: F20260620 14:53:15.629558 9018 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260620 14:53:15.629567 9008 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.629972 9007 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.630163 9014 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631304 9019 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631592 9002 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_96a3abe199c94222aea451130599b401 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.631625 9003 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_4f7f7c8b2fa84940bcb443efbbded490 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.632128 9004 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_13f389c96bd0448091e94f5127394533 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.632179 8997 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_34a7935bc68a42c3aa8f0c43b09b30a8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.632251 9010 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260620 14:53:15.632184 9012 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.633924 8999 master-stress-test.cc:298] Check failed: _s.ok() Bad status: F20260620 14:53:15.633929 Timed out: Error creating table default.Table_1d5a20c59b2741ca905b63fd9478cf1c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111) Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.633986 9009 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.634414 8998 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_63c7519d9a2a45b980b2d44a70aec200 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)F20260620 14:53:15.635548 9016 master-stress-test.cc:392] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.222.254:39515,127.7.222.253:34209,127.7.222.252:36651, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.222.252:36651: connect: Connection refused (error 111)
*** Check failure stack trace: ***
@ 0x7f7c08e9aa46 google::(anonymous namespace)::FailureSignalHandler() at ??:0
@ 0x7f7c0cfdc980 (unknown) at ??:0
@ 0x7f7c061c8e87 gsignal at ??:0
@ 0x7f7c061ca7f1 abort at ??:0
@ 0x7f7c08e8c9ad google::LogMessage::Fail() at ??:0
@ 0x7f7c08e8f88a google::LogMessage::SendToLog() at ??:0
@ 0x7f7c08e8c4de google::LogMessage::Flush() at ??:0
@ 0x7f7c08e8da19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x405273 kudu::MasterStressTest::DeleteTableThread() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/master-stress-test.cc:352
@ 0x444b44 std::__invoke_impl<>() at /opt/rh/devtoolset-8/root/usr/lib/gcc/x86_64-redhat-linux/8/../../../../include/c++/8/bits/invoke.h:73
@ 0x4449fd std::__invoke<>() at /opt/rh/devtoolset-8/root/usr/lib/gcc/x86_64-redhat-linux/8/../../../../include/c++/8/bits/invoke.h:95
@ 0x4449ba _ZNSt6thread8_InvokerISt5tupleIJMN4kudu16MasterStressTestEFvvEPNS2_26MasterStressTest_Test_TestEEEE9_M_invokeIJLm0ELm1EEEEDTclsr3stdE8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at /opt/rh/devtoolset-8/root/usr/lib/gcc/x86_64-redhat-linux/8/../../../../include/c++/8/thread:244
@ 0x44496e std::thread::_Invoker<>::operator()() at /opt/rh/devtoolset-8/root/usr/lib/gcc/x86_64-redhat-linux/8/../../../../include/c++/8/thread:253
@ 0x4446a9 std::thread::_State_impl<>::_M_run() at /opt/rh/devtoolset-8/root/usr/lib/gcc/x86_64-redhat-linux/8/../../../../include/c++/8/thread:196
@ 0x7f7c11918a4f execute_native_thread_routine at ??:0
@ 0x7f7c0cfd16db start_thread at ??:0
@ 0x7f7c062ab61f clone at ??:0