Note: This is test shard 3 of 3.
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/2
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260809 12:03:09.834677 8253 test_util.cc:268] Using random seed: 91428190
2026-08-09T12:03:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T12:03:09Z Disabled control of system clock
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskUkmmvv/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskUkmmvv/thirdparty/src/hadoop-3.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL: jdbc:derby:/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/metadb;create=true
Metastore Connection Driver : org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User: APP
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.derby.sql
Initialization script completed
schemaTool completed
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/security.properties
2026-08-09 12:03:16: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskUkmmvv/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskUkmmvv/thirdparty/src/hadoop-3.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Starting hive metastore on port 0
I20260809 12:03:24.692337 8253 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
/tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.15.126:45327
--webserver_interface=127.8.15.126
--webserver_port=0
--builtin_ntp_servers=127.8.15.84:46271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--hive_metastore_uris=thrift://127.0.0.1:44923
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260809 12:03:25.396831 8648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 12:03:25.397356 8648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 12:03:25.397707 8648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 12:03:25.408456 8648 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 12:03:25.408716 8648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 12:03:25.408857 8648 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 12:03:25.409066 8648 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 12:03:25.423085 8648 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.15.84:46271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:44923
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.15.126:45327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.15.126
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:06:41 UTC on ccycloud.quasar-bwoogy.root.comops.site
build id 4575991
ASAN enabled
I20260809 12:03:25.425520 8648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 12:03:25.428462 8648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 12:03:25.449201 8657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:25.449295 8658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:25.449889 8663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 12:03:25.451025 8648 server_base.cc:1034] running on GCE node
I20260809 12:03:25.452416 8648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 12:03:25.455119 8648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 12:03:25.456489 8648 hybrid_clock.cc:648] HybridClock initialized: now 1786277005456279 us; error 145 us; skew 500 ppm
I20260809 12:03:25.457130 8648 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 12:03:25.461930 8648 webserver.cc:460] Webserver started at http://127.8.15.126:37855/ using document root <none> and password file <none>
I20260809 12:03:25.463449 8648 fs_manager.cc:359] Metadata directory not provided
I20260809 12:03:25.463676 8648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 12:03:25.464331 8648 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 12:03:25.469244 8648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/data/instance:
uuid: "abee08c3147547cc8f3379b5fc437835"
format_stamp: "Formatted at 2026-08-09 12:03:25 on dist-test-slave-21b9"
I20260809 12:03:25.470446 8648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/wal/instance:
uuid: "abee08c3147547cc8f3379b5fc437835"
format_stamp: "Formatted at 2026-08-09 12:03:25 on dist-test-slave-21b9"
I20260809 12:03:25.481091 8648 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.006s sys 0.006s
I20260809 12:03:25.488649 8671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 12:03:25.490978 8648 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.003s
I20260809 12:03:25.491375 8648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/data,/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/wal
uuid: "abee08c3147547cc8f3379b5fc437835"
format_stamp: "Formatted at 2026-08-09 12:03:25 on dist-test-slave-21b9"
I20260809 12:03:25.491645 8648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 12:03:25.520783 8648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 12:03:25.522369 8648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 12:03:25.523025 8648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 12:03:25.575614 8648 rpc_server.cc:307] RPC server started. Bound to: 127.8.15.126:45327
I20260809 12:03:25.575745 8753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.15.126:45327 every 8 connection(s)
I20260809 12:03:25.578536 8648 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/data/info.pb
I20260809 12:03:25.588351 8253 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu as pid 8648
I20260809 12:03:25.588636 8754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:25.588887 8253 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/wal/instance
I20260809 12:03:25.593413 8253 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
/tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.15.125:37165
--webserver_interface=127.8.15.125
--webserver_port=0
--builtin_ntp_servers=127.8.15.84:46271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--hive_metastore_uris=thrift://127.0.0.1:44923
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260809 12:03:25.605103 8754 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } has no permanent_uuid. Determining permanent_uuid...
I20260809 12:03:25.640105 8754 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } has no permanent_uuid. Determining permanent_uuid...
W20260809 12:03:25.641539 8672 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
W20260809 12:03:25.644338 8754 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.15.125:37165: Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
I20260809 12:03:25.693769 8754 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } attempt: 1
W20260809 12:03:25.695968 8754 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.15.125:37165: Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
I20260809 12:03:25.764336 8754 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } attempt: 2
W20260809 12:03:25.766772 8754 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.15.125:37165: Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
I20260809 12:03:25.858103 8754 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } attempt: 3
W20260809 12:03:25.860186 8754 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.15.125:37165: Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
I20260809 12:03:26.003419 8754 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } attempt: 4
W20260809 12:03:26.005925 8754 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.15.125:37165: Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
W20260809 12:03:26.281199 8757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 12:03:26.281626 8757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 12:03:26.281842 8757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 12:03:26.292824 8757 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 12:03:26.293023 8757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 12:03:26.293149 8757 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 12:03:26.293300 8757 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 12:03:26.305230 8754 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } attempt: 5
W20260809 12:03:26.307336 8754 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.15.125:37165: Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
I20260809 12:03:26.307206 8757 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.15.84:46271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:44923
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.15.125:37165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.15.125
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:06:41 UTC on ccycloud.quasar-bwoogy.root.comops.site
build id 4575991
ASAN enabled
I20260809 12:03:26.308985 8757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 12:03:26.311141 8757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 12:03:26.328725 8766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:26.329479 8773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:26.329509 8775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 12:03:26.333001 8757 server_base.cc:1034] running on GCE node
I20260809 12:03:26.334005 8757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 12:03:26.335886 8757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 12:03:26.337226 8757 hybrid_clock.cc:648] HybridClock initialized: now 1786277006337061 us; error 47 us; skew 500 ppm
I20260809 12:03:26.337667 8757 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 12:03:26.341596 8757 webserver.cc:460] Webserver started at http://127.8.15.125:41665/ using document root <none> and password file <none>
I20260809 12:03:26.342515 8757 fs_manager.cc:359] Metadata directory not provided
I20260809 12:03:26.342717 8757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 12:03:26.343163 8757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 12:03:26.346819 8757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data/instance:
uuid: "061d8c3603f14343920d858e640b9dfd"
format_stamp: "Formatted at 2026-08-09 12:03:26 on dist-test-slave-21b9"
I20260809 12:03:26.347867 8757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/wal/instance:
uuid: "061d8c3603f14343920d858e640b9dfd"
format_stamp: "Formatted at 2026-08-09 12:03:26 on dist-test-slave-21b9"
I20260809 12:03:26.355633 8757 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260809 12:03:26.360994 8784 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 12:03:26.362526 8757 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260809 12:03:26.362795 8757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data,/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/wal
uuid: "061d8c3603f14343920d858e640b9dfd"
format_stamp: "Formatted at 2026-08-09 12:03:26 on dist-test-slave-21b9"
I20260809 12:03:26.363095 8757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 12:03:26.386240 8757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 12:03:26.387586 8757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 12:03:26.388095 8757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 12:03:26.434293 8757 rpc_server.cc:307] RPC server started. Bound to: 127.8.15.125:37165
I20260809 12:03:26.434401 8857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.15.125:37165 every 8 connection(s)
I20260809 12:03:26.436134 8757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data/info.pb
I20260809 12:03:26.441627 8858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:26.442553 8253 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu as pid 8757
I20260809 12:03:26.442809 8253 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/wal/instance
I20260809 12:03:26.444710 8253 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
/tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.15.124:33307
--webserver_interface=127.8.15.124
--webserver_port=0
--builtin_ntp_servers=127.8.15.84:46271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--hive_metastore_uris=thrift://127.0.0.1:44923
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260809 12:03:26.453826 8858 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } has no permanent_uuid. Determining permanent_uuid...
I20260809 12:03:26.473951 8858 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } has no permanent_uuid. Determining permanent_uuid...
I20260809 12:03:26.488350 8858 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } has no permanent_uuid. Determining permanent_uuid...
W20260809 12:03:26.490378 8788 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
W20260809 12:03:26.493206 8858 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.15.124:33307: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:03:26.542565 8858 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } attempt: 1
W20260809 12:03:26.544827 8858 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.15.124:33307: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:03:26.613154 8858 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } attempt: 2
W20260809 12:03:26.615552 8858 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.15.124:33307: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:03:26.706887 8858 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } attempt: 3
W20260809 12:03:26.709669 8858 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.15.124:33307: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:03:26.852988 8858 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } attempt: 4
I20260809 12:03:26.854589 8754 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } attempt: 6
W20260809 12:03:26.855495 8858 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.15.124:33307: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:03:26.864727 8754 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } has no permanent_uuid. Determining permanent_uuid...
W20260809 12:03:26.869344 8754 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.15.124:33307: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:03:26.921633 8754 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } attempt: 1
W20260809 12:03:26.923693 8754 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.15.124:33307: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:03:26.997916 8754 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } attempt: 2
W20260809 12:03:27.000229 8754 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.15.124:33307: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:03:27.113493 8754 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } attempt: 3
W20260809 12:03:27.115743 8754 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.15.124:33307: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
W20260809 12:03:27.126891 8859 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 12:03:27.127197 8859 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 12:03:27.127348 8859 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 12:03:27.136816 8859 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 12:03:27.136956 8859 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 12:03:27.137024 8859 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 12:03:27.137100 8859 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 12:03:27.147527 8859 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.15.84:46271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:44923
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.15.124:33307
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.15.124
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:06:41 UTC on ccycloud.quasar-bwoogy.root.comops.site
build id 4575991
ASAN enabled
I20260809 12:03:27.149019 8859 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 12:03:27.151170 8859 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 12:03:27.154757 8858 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } attempt: 5
W20260809 12:03:27.156777 8858 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.8.15.124:33307: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
W20260809 12:03:27.166106 8881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:27.166157 8882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:27.166353 8887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 12:03:27.167661 8859 server_base.cc:1034] running on GCE node
I20260809 12:03:27.168490 8859 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 12:03:27.170090 8859 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 12:03:27.171358 8859 hybrid_clock.cc:648] HybridClock initialized: now 1786277007171236 us; error 51 us; skew 500 ppm
I20260809 12:03:27.171728 8859 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 12:03:27.174501 8859 webserver.cc:460] Webserver started at http://127.8.15.124:44863/ using document root <none> and password file <none>
I20260809 12:03:27.175345 8859 fs_manager.cc:359] Metadata directory not provided
I20260809 12:03:27.175585 8859 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 12:03:27.175997 8859 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 12:03:27.179148 8859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data/instance:
uuid: "1e38ce37027547efa06785b9247f59bc"
format_stamp: "Formatted at 2026-08-09 12:03:27 on dist-test-slave-21b9"
I20260809 12:03:27.180091 8859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/wal/instance:
uuid: "1e38ce37027547efa06785b9247f59bc"
format_stamp: "Formatted at 2026-08-09 12:03:27 on dist-test-slave-21b9"
I20260809 12:03:27.186357 8859 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260809 12:03:27.190507 8893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 12:03:27.191910 8859 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 12:03:27.192159 8859 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data,/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/wal
uuid: "1e38ce37027547efa06785b9247f59bc"
format_stamp: "Formatted at 2026-08-09 12:03:27 on dist-test-slave-21b9"
I20260809 12:03:27.192373 8859 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 12:03:27.217008 8859 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 12:03:27.218501 8859 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 12:03:27.218906 8859 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 12:03:27.257738 8859 rpc_server.cc:307] RPC server started. Bound to: 127.8.15.124:33307
I20260809 12:03:27.257949 8974 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.15.124:33307 every 8 connection(s)
I20260809 12:03:27.259625 8859 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data/info.pb
I20260809 12:03:27.261806 8253 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu as pid 8859
I20260809 12:03:27.262015 8253 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/wal/instance
I20260809 12:03:27.265069 8754 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } attempt: 4
I20260809 12:03:27.266212 8975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:27.281253 8975 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } has no permanent_uuid. Determining permanent_uuid...
I20260809 12:03:27.303380 8754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835: Bootstrap starting.
I20260809 12:03:27.308341 8975 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } has no permanent_uuid. Determining permanent_uuid...
I20260809 12:03:27.314272 8754 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:27.316952 8754 log.cc:824] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835: Log is configured to *not* fsync() on all Append() calls
I20260809 12:03:27.322216 8975 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } has no permanent_uuid. Determining permanent_uuid...
I20260809 12:03:27.323055 8754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835: No bootstrap required, opened a new log
I20260809 12:03:27.337066 8975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: Bootstrap starting.
I20260809 12:03:27.339934 8754 raft_consensus.cc:348] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:27.340564 8754 raft_consensus.cc:374] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:27.340770 8754 raft_consensus.cc:729] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abee08c3147547cc8f3379b5fc437835, State: Initialized, Role: FOLLOWER
I20260809 12:03:27.342118 8754 consensus_queue.cc:260] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:27.343492 8975 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:27.343808 8987 sys_catalog.cc:455] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:27.344482 8987 sys_catalog.cc:458] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:27.346210 8975 log.cc:824] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: Log is configured to *not* fsync() on all Append() calls
I20260809 12:03:27.346508 8754 sys_catalog.cc:564] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 12:03:27.350147 8975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: No bootstrap required, opened a new log
I20260809 12:03:27.366268 8975 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:27.367148 8975 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:27.367435 8975 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e38ce37027547efa06785b9247f59bc, State: Initialized, Role: FOLLOWER
I20260809 12:03:27.368568 8975 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:27.371304 9017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:27.372210 9017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:27.373097 8975 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: configured and running, proceeding with master startup.
W20260809 12:03:27.386591 9014 catalog_manager.cc:1558] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 12:03:27.386861 9014 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 12:03:27.369238 8648 master_runner.cc:186] Error getting master registration for 127.8.15.125:37165: OK, instance_id { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" instance_seqno: 1786277006420489 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 12:03:27.389164 8648 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:03:27.420554 9046 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 12:03:27.420879 9046 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 12:03:27.412050 8859 master_runner.cc:186] Error getting master registration for 127.8.15.125:37165: OK, instance_id { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" instance_seqno: 1786277006420489 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 12:03:27.429872 8859 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:03:27.451469 8987 raft_consensus.cc:482] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:27.451984 8987 raft_consensus.cc:504] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
W20260809 12:03:27.471997 8900 tablet.cc:2369] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 12:03:27.472609 8938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "abee08c3147547cc8f3379b5fc437835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e38ce37027547efa06785b9247f59bc" is_pre_election: true
I20260809 12:03:27.474087 8938 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abee08c3147547cc8f3379b5fc437835 in term 0.
I20260809 12:03:27.475291 8676 leader_election.cc:302] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835; no voters:
I20260809 12:03:27.476959 9050 raft_consensus.cc:2781] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 12:03:27.477267 9050 raft_consensus.cc:482] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 12:03:27.477564 9050 raft_consensus.cc:3037] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:27.481950 8987 leader_election.cc:288] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
I20260809 12:03:27.482472 9050 raft_consensus.cc:504] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:27.487617 8938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "abee08c3147547cc8f3379b5fc437835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e38ce37027547efa06785b9247f59bc"
I20260809 12:03:27.487887 8938 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:27.492385 8938 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abee08c3147547cc8f3379b5fc437835 in term 1.
I20260809 12:03:27.492913 8676 leader_election.cc:302] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835; no voters:
I20260809 12:03:27.493184 9050 leader_election.cc:288] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 1 election: Requested vote from peers 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
I20260809 12:03:27.493335 8987 raft_consensus.cc:2781] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 12:03:27.493727 8987 raft_consensus.cc:686] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 1 LEADER]: Becoming Leader. State: Replica: abee08c3147547cc8f3379b5fc437835, State: Running, Role: LEADER
I20260809 12:03:27.495240 8987 consensus_queue.cc:237] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:27.505545 9050 sys_catalog.cc:455] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: SysCatalogTable state changed. Reason: New leader abee08c3147547cc8f3379b5fc437835. Latest consensus state: current_term: 1 leader_uuid: "abee08c3147547cc8f3379b5fc437835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:27.506002 9050 sys_catalog.cc:458] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: This master's current role is: LEADER
I20260809 12:03:27.509009 9052 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 12:03:27.516140 9052 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260809 12:03:27.528298 8680 tablet.cc:2369] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 12:03:27.534842 8938 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 1 FOLLOWER]: Refusing update from remote peer abee08c3147547cc8f3379b5fc437835: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 12:03:27.536235 9050 consensus_queue.cc:1035] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:27.554909 9017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader abee08c3147547cc8f3379b5fc437835. Latest consensus state: current_term: 1 leader_uuid: "abee08c3147547cc8f3379b5fc437835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:27.555637 9017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:27.559434 9053 mvcc.cc:205] Tried to move back new op lower bound from 7316590622845972480 to 7316590622714425344. Current Snapshot: MvccSnapshot[applied={T|T < 7316590622845972480}]
I20260809 12:03:27.561717 9050 sys_catalog.cc:455] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "abee08c3147547cc8f3379b5fc437835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:27.562029 9050 sys_catalog.cc:458] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: This master's current role is: LEADER
I20260809 12:03:27.568050 9052 catalog_manager.cc:1347] Generated new cluster ID: a0f048c3ad03482e99d22bfc404ede58
I20260809 12:03:27.568710 9052 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 12:03:27.577653 9017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "abee08c3147547cc8f3379b5fc437835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:27.578064 9017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:27.644861 9052 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 12:03:27.647073 9052 catalog_manager.cc:1504] Loading token signing keys...
I20260809 12:03:27.663308 9052 catalog_manager.cc:5868] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835: Generated new TSK 0
I20260809 12:03:27.665424 9052 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 12:03:27.668062 9052 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260809 12:03:27.670428 9052 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: -1
I20260809 12:03:27.686194 8253 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
/tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.15.65:0
--local_ip_for_outbound_sockets=127.8.15.65
--webserver_interface=127.8.15.65
--webserver_port=0
--tserver_master_addrs=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--builtin_ntp_servers=127.8.15.84:46271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260809 12:03:27.703999 8858 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } attempt: 6
I20260809 12:03:27.733553 8858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: Bootstrap starting.
I20260809 12:03:27.741925 8858 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:27.744653 8858 log.cc:824] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: Log is configured to *not* fsync() on all Append() calls
I20260809 12:03:27.759685 8858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: No bootstrap required, opened a new log
I20260809 12:03:27.782295 8858 raft_consensus.cc:348] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:27.783334 8858 raft_consensus.cc:374] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:27.783735 8858 raft_consensus.cc:729] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 061d8c3603f14343920d858e640b9dfd, State: Initialized, Role: FOLLOWER
I20260809 12:03:27.785213 8858 consensus_queue.cc:260] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:27.798972 8815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "abee08c3147547cc8f3379b5fc437835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "061d8c3603f14343920d858e640b9dfd"
I20260809 12:03:27.799536 8817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "abee08c3147547cc8f3379b5fc437835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "061d8c3603f14343920d858e640b9dfd" is_pre_election: true
I20260809 12:03:27.800585 8814 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:27.804131 8814 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 1 FOLLOWER]: Refusing update from remote peer abee08c3147547cc8f3379b5fc437835: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 12:03:27.823217 8858 sys_catalog.cc:564] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 12:03:27.824393 9050 consensus_queue.cc:1035] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:27.825589 9067 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:27.825953 9067 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:27.905997 9067 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: SysCatalogTable state changed. Reason: New leader abee08c3147547cc8f3379b5fc437835. Latest consensus state: current_term: 1 leader_uuid: "abee08c3147547cc8f3379b5fc437835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:27.906840 9067 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:27.907166 9077 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "abee08c3147547cc8f3379b5fc437835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:27.907733 9077 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:28.034924 9092 catalog_manager.cc:1259] Loaded cluster ID: a0f048c3ad03482e99d22bfc404ede58
I20260809 12:03:28.035063 9092 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: loading cluster ID for follower catalog manager: success
I20260809 12:03:28.047384 9092 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: acquiring CA information for follower catalog manager: success
I20260809 12:03:28.051451 9092 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 12:03:28.219118 9050 sys_catalog.cc:455] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "abee08c3147547cc8f3379b5fc437835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:28.219643 9050 sys_catalog.cc:458] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: This master's current role is: LEADER
I20260809 12:03:28.424260 9046 catalog_manager.cc:1259] Loaded cluster ID: a0f048c3ad03482e99d22bfc404ede58
I20260809 12:03:28.424686 9046 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: loading cluster ID for follower catalog manager: success
I20260809 12:03:28.430183 9046 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: acquiring CA information for follower catalog manager: success
I20260809 12:03:28.434000 9046 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 12:03:28.486246 9062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 12:03:28.486647 9062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 12:03:28.486815 9062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 12:03:28.497393 9062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 12:03:28.497737 9062 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.15.65
I20260809 12:03:28.510779 9062 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.15.84:46271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.15.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.15.65
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.15.65
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:06:41 UTC on ccycloud.quasar-bwoogy.root.comops.site
build id 4575991
ASAN enabled
I20260809 12:03:28.512754 9062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 12:03:28.515106 9062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 12:03:28.537601 9108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:28.537730 9109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:28.538898 9111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 12:03:28.539813 9062 server_base.cc:1034] running on GCE node
I20260809 12:03:28.540477 9062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 12:03:28.541698 9062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 12:03:28.543829 9062 hybrid_clock.cc:648] HybridClock initialized: now 1786277008543638 us; error 46 us; skew 500 ppm
I20260809 12:03:28.544276 9062 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 12:03:28.549240 9062 webserver.cc:460] Webserver started at http://127.8.15.65:33551/ using document root <none> and password file <none>
I20260809 12:03:28.550498 9062 fs_manager.cc:359] Metadata directory not provided
I20260809 12:03:28.550724 9062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 12:03:28.551235 9062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 12:03:28.554242 9115 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abee08c3147547cc8f3379b5fc437835)
I20260809 12:03:28.554553 9115 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:28.556011 9062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/data/instance:
uuid: "f05528ac015e4f0cb0aa748afdc2c12e"
format_stamp: "Formatted at 2026-08-09 12:03:28 on dist-test-slave-21b9"
I20260809 12:03:28.556568 9115 leader_election.cc:288] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165)
I20260809 12:03:28.557474 8814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e38ce37027547efa06785b9247f59bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "061d8c3603f14343920d858e640b9dfd" is_pre_election: true
I20260809 12:03:28.557582 8713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e38ce37027547efa06785b9247f59bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abee08c3147547cc8f3379b5fc437835" is_pre_election: true
I20260809 12:03:28.557952 9062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/wal/instance:
uuid: "f05528ac015e4f0cb0aa748afdc2c12e"
format_stamp: "Formatted at 2026-08-09 12:03:28 on dist-test-slave-21b9"
I20260809 12:03:28.558853 8896 leader_election.cc:302] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e38ce37027547efa06785b9247f59bc; no voters: 061d8c3603f14343920d858e640b9dfd, abee08c3147547cc8f3379b5fc437835
I20260809 12:03:28.559417 9115 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 12:03:28.566692 9062 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.003s sys 0.003s
I20260809 12:03:28.571662 9121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 12:03:28.573323 9062 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260809 12:03:28.573585 9062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/data,/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/wal
uuid: "f05528ac015e4f0cb0aa748afdc2c12e"
format_stamp: "Formatted at 2026-08-09 12:03:28 on dist-test-slave-21b9"
I20260809 12:03:28.574025 9062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 12:03:28.601380 9062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 12:03:28.602478 9062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 12:03:28.602972 9062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 12:03:28.604548 9062 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 12:03:28.607601 9062 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 12:03:28.607734 9062 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 12:03:28.607973 9062 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 12:03:28.608081 9062 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 12:03:28.720914 9062 rpc_server.cc:307] RPC server started. Bound to: 127.8.15.65:38723
I20260809 12:03:28.720968 9296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.15.65:38723 every 8 connection(s)
I20260809 12:03:28.723187 9062 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/data/info.pb
I20260809 12:03:28.724002 8253 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu as pid 9062
I20260809 12:03:28.724227 8253 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/wal/instance
I20260809 12:03:28.741530 8253 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
/tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.15.66:0
--local_ip_for_outbound_sockets=127.8.15.66
--webserver_interface=127.8.15.66
--webserver_port=0
--tserver_master_addrs=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--builtin_ntp_servers=127.8.15.84:46271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260809 12:03:28.779663 9298 heartbeater.cc:347] Connected to a master server at 127.8.15.126:45327
I20260809 12:03:28.780385 9298 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:28.782514 9298 heartbeater.cc:511] Master 127.8.15.126:45327 requested a full tablet report, sending...
I20260809 12:03:28.789479 8697 ts_manager.cc:194] Registered new tserver with Master: f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
I20260809 12:03:28.792691 8697 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.15.65:39207
I20260809 12:03:28.796309 9300 heartbeater.cc:347] Connected to a master server at 127.8.15.124:33307
I20260809 12:03:28.796540 9300 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:28.797526 9300 heartbeater.cc:511] Master 127.8.15.124:33307 requested a full tablet report, sending...
I20260809 12:03:28.800207 8920 ts_manager.cc:194] Registered new tserver with Master: f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
I20260809 12:03:28.802682 9308 heartbeater.cc:347] Connected to a master server at 127.8.15.125:37165
I20260809 12:03:28.802860 9308 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:28.803562 9308 heartbeater.cc:511] Master 127.8.15.125:37165 requested a full tablet report, sending...
I20260809 12:03:28.805470 8802 ts_manager.cc:194] Registered new tserver with Master: f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
I20260809 12:03:29.298673 9298 heartbeater.cc:503] Master 127.8.15.126:45327 was elected leader, sending a full tablet report...
W20260809 12:03:29.513032 9314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 12:03:29.513476 9314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 12:03:29.513732 9314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 12:03:29.525933 9314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 12:03:29.526278 9314 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.15.66
I20260809 12:03:29.540346 9314 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.15.84:46271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.15.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.15.66
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.15.66
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:06:41 UTC on ccycloud.quasar-bwoogy.root.comops.site
build id 4575991
ASAN enabled
I20260809 12:03:29.541791 9314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 12:03:29.544301 9314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 12:03:29.566828 9325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:29.567178 9326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:29.567306 9330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 12:03:29.569739 9314 server_base.cc:1034] running on GCE node
I20260809 12:03:29.570667 9314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 12:03:29.571910 9314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 12:03:29.573148 9314 hybrid_clock.cc:648] HybridClock initialized: now 1786277009573070 us; error 53 us; skew 500 ppm
I20260809 12:03:29.573462 9314 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 12:03:29.582306 9314 webserver.cc:460] Webserver started at http://127.8.15.66:37985/ using document root <none> and password file <none>
I20260809 12:03:29.583485 9314 fs_manager.cc:359] Metadata directory not provided
I20260809 12:03:29.583714 9314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 12:03:29.584120 9314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 12:03:29.588076 9314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/data/instance:
uuid: "cde39fbb4ced4d049fef6754c3f3e796"
format_stamp: "Formatted at 2026-08-09 12:03:29 on dist-test-slave-21b9"
I20260809 12:03:29.589146 9314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/wal/instance:
uuid: "cde39fbb4ced4d049fef6754c3f3e796"
format_stamp: "Formatted at 2026-08-09 12:03:29 on dist-test-slave-21b9"
I20260809 12:03:29.596897 9314 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.002s
I20260809 12:03:29.602677 9340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 12:03:29.604367 9314 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260809 12:03:29.604534 9314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/data,/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/wal
uuid: "cde39fbb4ced4d049fef6754c3f3e796"
format_stamp: "Formatted at 2026-08-09 12:03:29 on dist-test-slave-21b9"
I20260809 12:03:29.604724 9314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 12:03:29.611534 9345 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abee08c3147547cc8f3379b5fc437835)
I20260809 12:03:29.611902 9345 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:29.613580 9345 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
I20260809 12:03:29.614095 8938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "061d8c3603f14343920d858e640b9dfd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e38ce37027547efa06785b9247f59bc" is_pre_election: true
I20260809 12:03:29.614193 8713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "061d8c3603f14343920d858e640b9dfd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abee08c3147547cc8f3379b5fc437835" is_pre_election: true
I20260809 12:03:29.615374 8788 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:03:29.615816 9345 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 12:03:29.628574 9314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 12:03:29.630100 9314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 12:03:29.630656 9314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 12:03:29.632475 9314 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 12:03:29.634888 9314 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 12:03:29.635033 9314 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 12:03:29.635236 9314 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 12:03:29.635413 9314 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260809 12:03:29.742642 9314 rpc_server.cc:307] RPC server started. Bound to: 127.8.15.66:41479
I20260809 12:03:29.742707 9526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.15.66:41479 every 8 connection(s)
I20260809 12:03:29.745126 9314 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/data/info.pb
I20260809 12:03:29.748073 8253 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu as pid 9314
I20260809 12:03:29.748468 8253 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/wal/instance
I20260809 12:03:29.755817 8253 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
/tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.15.67:0
--local_ip_for_outbound_sockets=127.8.15.67
--webserver_interface=127.8.15.67
--webserver_port=0
--tserver_master_addrs=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--builtin_ntp_servers=127.8.15.84:46271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260809 12:03:29.804921 9530 heartbeater.cc:347] Connected to a master server at 127.8.15.125:37165
I20260809 12:03:29.805140 9527 heartbeater.cc:347] Connected to a master server at 127.8.15.126:45327
I20260809 12:03:29.805373 9530 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:29.805414 9527 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:29.805812 9529 heartbeater.cc:347] Connected to a master server at 127.8.15.124:33307
I20260809 12:03:29.806011 9529 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:29.807120 9530 heartbeater.cc:511] Master 127.8.15.125:37165 requested a full tablet report, sending...
I20260809 12:03:29.807178 9529 heartbeater.cc:511] Master 127.8.15.124:33307 requested a full tablet report, sending...
I20260809 12:03:29.807185 9527 heartbeater.cc:511] Master 127.8.15.126:45327 requested a full tablet report, sending...
I20260809 12:03:29.809413 8802 ts_manager.cc:194] Registered new tserver with Master: cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479)
I20260809 12:03:29.810555 8920 ts_manager.cc:194] Registered new tserver with Master: cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479)
I20260809 12:03:29.811299 8697 ts_manager.cc:194] Registered new tserver with Master: cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479)
I20260809 12:03:29.812444 8697 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.15.66:35365
I20260809 12:03:29.833590 9551 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abee08c3147547cc8f3379b5fc437835)
I20260809 12:03:29.833848 9551 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:29.834968 9551 leader_election.cc:288] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165)
I20260809 12:03:29.835553 8713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e38ce37027547efa06785b9247f59bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abee08c3147547cc8f3379b5fc437835" is_pre_election: true
I20260809 12:03:29.835565 8814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e38ce37027547efa06785b9247f59bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "061d8c3603f14343920d858e640b9dfd" is_pre_election: true
I20260809 12:03:29.836375 8895 leader_election.cc:302] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e38ce37027547efa06785b9247f59bc; no voters: 061d8c3603f14343920d858e640b9dfd, abee08c3147547cc8f3379b5fc437835
I20260809 12:03:29.836934 9551 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 12:03:30.315089 9527 heartbeater.cc:503] Master 127.8.15.126:45327 was elected leader, sending a full tablet report...
I20260809 12:03:30.431583 9552 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abee08c3147547cc8f3379b5fc437835)
I20260809 12:03:30.431869 9552 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:30.432894 9552 leader_election.cc:288] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165)
I20260809 12:03:30.433311 8713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e38ce37027547efa06785b9247f59bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "abee08c3147547cc8f3379b5fc437835" is_pre_election: true
I20260809 12:03:30.433864 8814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e38ce37027547efa06785b9247f59bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "061d8c3603f14343920d858e640b9dfd" is_pre_election: true
I20260809 12:03:30.434576 8896 leader_election.cc:302] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e38ce37027547efa06785b9247f59bc; no voters: 061d8c3603f14343920d858e640b9dfd, abee08c3147547cc8f3379b5fc437835
I20260809 12:03:30.434871 9552 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260809 12:03:30.459568 9550 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 12:03:30.459892 9550 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 12:03:30.460022 9550 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 12:03:30.468611 9550 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 12:03:30.468885 9550 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.15.67
I20260809 12:03:30.479616 9550 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.15.84:46271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.15.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.15.67
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.15.67
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:06:41 UTC on ccycloud.quasar-bwoogy.root.comops.site
build id 4575991
ASAN enabled
I20260809 12:03:30.481175 9550 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 12:03:30.483441 9550 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 12:03:30.500504 9557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:30.501344 9558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:30.501776 9563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 12:03:30.502346 9550 server_base.cc:1034] running on GCE node
I20260809 12:03:30.503187 9550 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 12:03:30.504205 9550 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 12:03:30.505450 9550 hybrid_clock.cc:648] HybridClock initialized: now 1786277010505347 us; error 63 us; skew 500 ppm
I20260809 12:03:30.505784 9550 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 12:03:30.508467 9550 webserver.cc:460] Webserver started at http://127.8.15.67:44083/ using document root <none> and password file <none>
I20260809 12:03:30.509240 9550 fs_manager.cc:359] Metadata directory not provided
I20260809 12:03:30.509385 9550 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 12:03:30.509717 9550 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 12:03:30.512802 9550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/data/instance:
uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1"
format_stamp: "Formatted at 2026-08-09 12:03:30 on dist-test-slave-21b9"
I20260809 12:03:30.513651 9550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/wal/instance:
uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1"
format_stamp: "Formatted at 2026-08-09 12:03:30 on dist-test-slave-21b9"
I20260809 12:03:30.519459 9550 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260809 12:03:30.523643 9570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 12:03:30.525224 9550 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 12:03:30.525447 9550 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/data,/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/wal
uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1"
format_stamp: "Formatted at 2026-08-09 12:03:30 on dist-test-slave-21b9"
I20260809 12:03:30.525669 9550 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 12:03:30.540665 9550 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 12:03:30.541654 9550 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 12:03:30.542071 9550 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 12:03:30.543217 9550 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 12:03:30.545233 9550 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 12:03:30.545339 9550 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 12:03:30.545506 9550 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 12:03:30.545601 9550 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 12:03:30.621960 9550 rpc_server.cc:307] RPC server started. Bound to: 127.8.15.67:34793
I20260809 12:03:30.622027 9759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.15.67:34793 every 8 connection(s)
I20260809 12:03:30.623457 9550 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/data/info.pb
I20260809 12:03:30.627533 8253 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu as pid 9550
I20260809 12:03:30.627720 8253 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/wal/instance
I20260809 12:03:30.673317 9763 heartbeater.cc:347] Connected to a master server at 127.8.15.126:45327
I20260809 12:03:30.673331 9766 heartbeater.cc:347] Connected to a master server at 127.8.15.125:37165
I20260809 12:03:30.673736 9766 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:30.673738 9763 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:30.674994 9763 heartbeater.cc:511] Master 127.8.15.126:45327 requested a full tablet report, sending...
I20260809 12:03:30.675400 9765 heartbeater.cc:347] Connected to a master server at 127.8.15.124:33307
I20260809 12:03:30.675578 9765 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:30.675817 9766 heartbeater.cc:511] Master 127.8.15.125:37165 requested a full tablet report, sending...
I20260809 12:03:30.676446 9765 heartbeater.cc:511] Master 127.8.15.124:33307 requested a full tablet report, sending...
I20260809 12:03:30.677292 8802 ts_manager.cc:194] Registered new tserver with Master: e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:30.677366 8697 ts_manager.cc:194] Registered new tserver with Master: e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:30.677841 8920 ts_manager.cc:194] Registered new tserver with Master: e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:30.678464 8697 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.8.15.67:58889
I20260809 12:03:30.684018 8253 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 12:03:30.730494 8697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46478:
name: "default.Table_e97f6ba8b3354e24926902268c43a5e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:30.730741 8696 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46478:
name: "default.Table_badbfc92917e45a5aa60e47244ae5ff5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:30.732776 8693 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46478:
name: "default.Table_520e75ee39c74e6985dbd81c6f2e32f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:30.734895 8689 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46478:
name: "default.Table_939805886d394093ad5a402efa777cb4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:30.736729 8687 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46478:
name: "default.Table_8ccd04aad0ba4f5480308b917eb8a12e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:30.737565 8686 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46478:
name: "default.Table_da029d70439d48cc842a66906f93d903"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:30.739632 8685 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46478:
name: "default.Table_5e7b5144853246789d8fc5da01626dc7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:30.740187 8683 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46478:
name: "default.Table_22e16baa34234ab0a0b7841c1041884c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:30.740763 8684 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46478:
name: "default.Table_22580336a00e422aab032707ca16836e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 12:03:30.742388 8696 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_badbfc92917e45a5aa60e47244ae5ff5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260809 12:03:30.748724 8687 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_8ccd04aad0ba4f5480308b917eb8a12e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260809 12:03:30.748894 8693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_520e75ee39c74e6985dbd81c6f2e32f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260809 12:03:30.750111 8689 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_939805886d394093ad5a402efa777cb4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 12:03:30.750669 8682 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46478:
name: "default.Table_1692567d64f8469c8550ff24a79d3e57"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 12:03:30.751628 8686 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_da029d70439d48cc842a66906f93d903 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260809 12:03:30.751718 8697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_e97f6ba8b3354e24926902268c43a5e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 12:03:30.778154 8253 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu pid 8648
I20260809 12:03:30.779933 8745 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 12:03:30.947460 8253 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu with pid 8648
I20260809 12:03:30.973470 9853 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abee08c3147547cc8f3379b5fc437835)
I20260809 12:03:30.973737 9853 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:30.974670 9853 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
I20260809 12:03:30.975476 8938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "061d8c3603f14343920d858e640b9dfd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e38ce37027547efa06785b9247f59bc" is_pre_election: true
W20260809 12:03:30.988262 8786 connection.cc:535] client connection to 127.8.15.126:45327 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:30.989660 9780 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.8.15.126:45327)
W20260809 12:03:30.990109 9298 heartbeater.cc:644] Failed to heartbeat to 127.8.15.126:45327 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.8.15.126:45327 (error 108)
I20260809 12:03:30.991978 9857 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abee08c3147547cc8f3379b5fc437835)
I20260809 12:03:30.992151 9857 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
W20260809 12:03:30.992231 9527 heartbeater.cc:644] Failed to heartbeat to 127.8.15.126:45327 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.8.15.126:45327 (error 108)
I20260809 12:03:30.992923 9857 leader_election.cc:288] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165)
I20260809 12:03:30.993266 8814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e38ce37027547efa06785b9247f59bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "061d8c3603f14343920d858e640b9dfd" is_pre_election: true
I20260809 12:03:30.993662 8814 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e38ce37027547efa06785b9247f59bc in term 1.
I20260809 12:03:30.994196 8895 leader_election.cc:302] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd, 1e38ce37027547efa06785b9247f59bc; no voters:
I20260809 12:03:30.994594 9857 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 12:03:30.994926 9857 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader abee08c3147547cc8f3379b5fc437835)
I20260809 12:03:30.995127 9857 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 1 FOLLOWER]: Advancing to term 2
W20260809 12:03:30.996699 8786 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:03:30.996781 8896 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:03:30.996876 8786 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:03:30.997134 9853 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 12:03:30.998603 9857 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
W20260809 12:03:30.998747 8896 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:03:30.999632 9857 leader_election.cc:288] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 2 election: Requested vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165)
I20260809 12:03:30.999750 8814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e38ce37027547efa06785b9247f59bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "061d8c3603f14343920d858e640b9dfd"
I20260809 12:03:30.999959 8814 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 1 FOLLOWER]: Advancing to term 2
I20260809 12:03:31.002987 8814 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e38ce37027547efa06785b9247f59bc in term 2.
I20260809 12:03:31.003571 8895 leader_election.cc:302] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd, 1e38ce37027547efa06785b9247f59bc; no voters:
I20260809 12:03:31.003875 9857 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 2 FOLLOWER]: Leader election won for term 2
W20260809 12:03:31.004210 8896 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:03:31.004446 9857 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 2 LEADER]: Becoming Leader. State: Replica: 1e38ce37027547efa06785b9247f59bc, State: Running, Role: LEADER
I20260809 12:03:31.008355 9857 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:31.010463 9862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e38ce37027547efa06785b9247f59bc. Latest consensus state: current_term: 2 leader_uuid: "1e38ce37027547efa06785b9247f59bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:31.010874 9862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: This master's current role is: LEADER
I20260809 12:03:31.012547 9865 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 12:03:31.014882 9865 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 12:03:31.016835 9865 catalog_manager.cc:1259] Loaded cluster ID: a0f048c3ad03482e99d22bfc404ede58
I20260809 12:03:31.016922 9865 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 12:03:31.018458 9865 catalog_manager.cc:1504] Loading token signing keys...
I20260809 12:03:31.019556 9865 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: Loaded TSK: 0
I20260809 12:03:31.020843 9865 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 12:03:31.021853 9865 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260809 12:03:31.022802 9865 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: -1
I20260809 12:03:31.028357 8920 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59982:
name: "default.Table_1692567d64f8469c8550ff24a79d3e57"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:31.028959 8911 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59982:
name: "default.Table_5e7b5144853246789d8fc5da01626dc7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:31.029565 8909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59982:
name: "default.Table_badbfc92917e45a5aa60e47244ae5ff5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:31.028357 8913 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59982:
name: "default.Table_22580336a00e422aab032707ca16836e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:31.028492 8919 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59982:
name: "default.Table_22e16baa34234ab0a0b7841c1041884c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:31.031114 8908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59982:
name: "default.Table_e97f6ba8b3354e24926902268c43a5e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:31.031190 8907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59982:
name: "default.Table_520e75ee39c74e6985dbd81c6f2e32f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:31.031694 8905 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59982:
name: "default.Table_939805886d394093ad5a402efa777cb4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:31.032306 8904 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59982:
name: "default.Table_8ccd04aad0ba4f5480308b917eb8a12e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:31.032932 8903 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59982:
name: "default.Table_da029d70439d48cc842a66906f93d903"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 12:03:31.043049 8920 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_1692567d64f8469c8550ff24a79d3e57 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260809 12:03:31.045526 8911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_5e7b5144853246789d8fc5da01626dc7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260809 12:03:31.046645 8909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_badbfc92917e45a5aa60e47244ae5ff5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260809 12:03:31.047672 8903 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_da029d70439d48cc842a66906f93d903 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260809 12:03:31.048625 8904 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_8ccd04aad0ba4f5480308b917eb8a12e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260809 12:03:31.049577 8905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_939805886d394093ad5a402efa777cb4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260809 12:03:31.050462 8907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_520e75ee39c74e6985dbd81c6f2e32f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260809 12:03:31.051463 8908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_e97f6ba8b3354e24926902268c43a5e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260809 12:03:31.051673 8913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_22580336a00e422aab032707ca16836e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260809 12:03:31.052719 8919 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_22e16baa34234ab0a0b7841c1041884c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 12:03:31.181667 9763 heartbeater.cc:503] Master 127.8.15.126:45327 was elected leader, sending a full tablet report...
W20260809 12:03:31.194962 9763 heartbeater.cc:644] Failed to heartbeat to 127.8.15.126:45327 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:03:31.250159 8920 catalog_manager.cc:2148] created HMS catalog entry for table [id=560f9d6ae1904b3ba73a0b3ed65fddbe]
I20260809 12:03:31.254673 8814 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 2 FOLLOWER]: Refusing update from remote peer 1e38ce37027547efa06785b9247f59bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20260809 12:03:31.255501 9862 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260809 12:03:31.255800 8896 consensus_peers.cc:487] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc -> Peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Couldn't send request to peer abee08c3147547cc8f3379b5fc437835. Status: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 12:03:31.276554 9853 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e38ce37027547efa06785b9247f59bc. Latest consensus state: current_term: 2 leader_uuid: "1e38ce37027547efa06785b9247f59bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:31.276813 9853 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:31.279984 9853 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "1e38ce37027547efa06785b9247f59bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:31.280300 9853 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:31.288090 9857 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "1e38ce37027547efa06785b9247f59bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:31.288453 9857 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: This master's current role is: LEADER
I20260809 12:03:31.294991 8920 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59982:
table { table_name: "default.Table_1692567d64f8469c8550ff24a79d3e57" } new_table_name: "default.Table_e53628efaa614b888fbce28b06e96b27" modify_external_catalogs: true
I20260809 12:03:31.296180 8911 catalog_manager.cc:2148] created HMS catalog entry for table [id=cdf9b699ee5c4b34ae416c1bc8922daf]
I20260809 12:03:31.305058 8911 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59982:
table { table_name: "default.Table_5e7b5144853246789d8fc5da01626dc7" } new_table_name: "default.Table_c9c43a2a0d1a4e209f094445b8de091c" modify_external_catalogs: true
I20260809 12:03:31.317641 9649 tablet_service.cc:1467] Processing CreateTablet for tablet 85bb8662f3174951bbdb45c8fcbaa975 (DEFAULT_TABLE table=default.table_1692567d64f8469c8550ff24a79d3e57 [id=560f9d6ae1904b3ba73a0b3ed65fddbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.323084 9649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85bb8662f3174951bbdb45c8fcbaa975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.335645 9647 tablet_service.cc:1467] Processing CreateTablet for tablet ab556e769b194e57bb804de0e4f4b0e1 (DEFAULT_TABLE table=default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.336261 9647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab556e769b194e57bb804de0e4f4b0e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.338967 9425 tablet_service.cc:1467] Processing CreateTablet for tablet ab556e769b194e57bb804de0e4f4b0e1 (DEFAULT_TABLE table=default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.340571 9425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab556e769b194e57bb804de0e4f4b0e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.343456 9427 tablet_service.cc:1467] Processing CreateTablet for tablet 85bb8662f3174951bbdb45c8fcbaa975 (DEFAULT_TABLE table=default.table_1692567d64f8469c8550ff24a79d3e57 [id=560f9d6ae1904b3ba73a0b3ed65fddbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.343894 9427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85bb8662f3174951bbdb45c8fcbaa975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.344257 9198 tablet_service.cc:1467] Processing CreateTablet for tablet ab556e769b194e57bb804de0e4f4b0e1 (DEFAULT_TABLE table=default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.345964 9198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab556e769b194e57bb804de0e4f4b0e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.347687 9200 tablet_service.cc:1467] Processing CreateTablet for tablet 85bb8662f3174951bbdb45c8fcbaa975 (DEFAULT_TABLE table=default.table_1692567d64f8469c8550ff24a79d3e57 [id=560f9d6ae1904b3ba73a0b3ed65fddbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.348287 9200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85bb8662f3174951bbdb45c8fcbaa975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.387217 9888 tablet_bootstrap.cc:492] T 85bb8662f3174951bbdb45c8fcbaa975 P f05528ac015e4f0cb0aa748afdc2c12e: Bootstrap starting.
I20260809 12:03:31.388345 9886 tablet_bootstrap.cc:492] T 85bb8662f3174951bbdb45c8fcbaa975 P cde39fbb4ced4d049fef6754c3f3e796: Bootstrap starting.
I20260809 12:03:31.391592 9884 tablet_bootstrap.cc:492] T 85bb8662f3174951bbdb45c8fcbaa975 P e0b5e4c0505c4122ae1349ee4beb5bd1: Bootstrap starting.
I20260809 12:03:31.395418 9884 tablet_bootstrap.cc:654] T 85bb8662f3174951bbdb45c8fcbaa975 P e0b5e4c0505c4122ae1349ee4beb5bd1: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:31.396759 9884 log.cc:824] T 85bb8662f3174951bbdb45c8fcbaa975 P e0b5e4c0505c4122ae1349ee4beb5bd1: Log is configured to *not* fsync() on all Append() calls
I20260809 12:03:31.396344 9888 tablet_bootstrap.cc:654] T 85bb8662f3174951bbdb45c8fcbaa975 P f05528ac015e4f0cb0aa748afdc2c12e: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:31.402554 9888 log.cc:824] T 85bb8662f3174951bbdb45c8fcbaa975 P f05528ac015e4f0cb0aa748afdc2c12e: Log is configured to *not* fsync() on all Append() calls
I20260809 12:03:31.408425 9886 tablet_bootstrap.cc:654] T 85bb8662f3174951bbdb45c8fcbaa975 P cde39fbb4ced4d049fef6754c3f3e796: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:31.409808 9886 log.cc:824] T 85bb8662f3174951bbdb45c8fcbaa975 P cde39fbb4ced4d049fef6754c3f3e796: Log is configured to *not* fsync() on all Append() calls
I20260809 12:03:31.410720 9884 tablet_bootstrap.cc:492] T 85bb8662f3174951bbdb45c8fcbaa975 P e0b5e4c0505c4122ae1349ee4beb5bd1: No bootstrap required, opened a new log
I20260809 12:03:31.411212 9884 ts_tablet_manager.cc:1397] T 85bb8662f3174951bbdb45c8fcbaa975 P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent bootstrapping tablet: real 0.020s user 0.008s sys 0.011s
I20260809 12:03:31.411803 9888 tablet_bootstrap.cc:492] T 85bb8662f3174951bbdb45c8fcbaa975 P f05528ac015e4f0cb0aa748afdc2c12e: No bootstrap required, opened a new log
I20260809 12:03:31.412101 9888 ts_tablet_manager.cc:1397] T 85bb8662f3174951bbdb45c8fcbaa975 P f05528ac015e4f0cb0aa748afdc2c12e: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.011s
I20260809 12:03:31.421862 9886 tablet_bootstrap.cc:492] T 85bb8662f3174951bbdb45c8fcbaa975 P cde39fbb4ced4d049fef6754c3f3e796: No bootstrap required, opened a new log
I20260809 12:03:31.422173 9886 ts_tablet_manager.cc:1397] T 85bb8662f3174951bbdb45c8fcbaa975 P cde39fbb4ced4d049fef6754c3f3e796: Time spent bootstrapping tablet: real 0.034s user 0.008s sys 0.004s
I20260809 12:03:31.422235 9884 raft_consensus.cc:348] T 85bb8662f3174951bbdb45c8fcbaa975 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } }
I20260809 12:03:31.422437 9888 raft_consensus.cc:348] T 85bb8662f3174951bbdb45c8fcbaa975 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } }
I20260809 12:03:31.422874 9888 raft_consensus.cc:374] T 85bb8662f3174951bbdb45c8fcbaa975 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:31.422937 9884 raft_consensus.cc:374] T 85bb8662f3174951bbdb45c8fcbaa975 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:31.422986 9888 raft_consensus.cc:729] T 85bb8662f3174951bbdb45c8fcbaa975 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f05528ac015e4f0cb0aa748afdc2c12e, State: Initialized, Role: FOLLOWER
I20260809 12:03:31.423182 9884 raft_consensus.cc:729] T 85bb8662f3174951bbdb45c8fcbaa975 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0b5e4c0505c4122ae1349ee4beb5bd1, State: Initialized, Role: FOLLOWER
I20260809 12:03:31.423835 9888 consensus_queue.cc:260] T 85bb8662f3174951bbdb45c8fcbaa975 P f05528ac015e4f0cb0aa748afdc2c12e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } }
I20260809 12:03:31.424029 9884 consensus_queue.cc:260] T 85bb8662f3174951bbdb45c8fcbaa975 P e0b5e4c0505c4122ae1349ee4beb5bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } }
I20260809 12:03:31.433557 9886 raft_consensus.cc:348] T 85bb8662f3174951bbdb45c8fcbaa975 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } }
I20260809 12:03:31.434082 9886 raft_consensus.cc:374] T 85bb8662f3174951bbdb45c8fcbaa975 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:31.434173 9886 raft_consensus.cc:729] T 85bb8662f3174951bbdb45c8fcbaa975 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cde39fbb4ced4d049fef6754c3f3e796, State: Initialized, Role: FOLLOWER
I20260809 12:03:31.436138 9888 ts_tablet_manager.cc:1428] T 85bb8662f3174951bbdb45c8fcbaa975 P f05528ac015e4f0cb0aa748afdc2c12e: Time spent starting tablet: real 0.024s user 0.014s sys 0.009s
I20260809 12:03:31.441609 9888 tablet_bootstrap.cc:492] T ab556e769b194e57bb804de0e4f4b0e1 P f05528ac015e4f0cb0aa748afdc2c12e: Bootstrap starting.
I20260809 12:03:31.443424 9888 tablet_bootstrap.cc:654] T ab556e769b194e57bb804de0e4f4b0e1 P f05528ac015e4f0cb0aa748afdc2c12e: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:31.444940 9765 heartbeater.cc:503] Master 127.8.15.124:33307 was elected leader, sending a full tablet report...
I20260809 12:03:31.448021 9886 consensus_queue.cc:260] T 85bb8662f3174951bbdb45c8fcbaa975 P cde39fbb4ced4d049fef6754c3f3e796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } }
I20260809 12:03:31.452714 9884 ts_tablet_manager.cc:1428] T 85bb8662f3174951bbdb45c8fcbaa975 P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent starting tablet: real 0.041s user 0.015s sys 0.005s
I20260809 12:03:31.454152 9888 tablet_bootstrap.cc:492] T ab556e769b194e57bb804de0e4f4b0e1 P f05528ac015e4f0cb0aa748afdc2c12e: No bootstrap required, opened a new log
I20260809 12:03:31.454320 9888 ts_tablet_manager.cc:1397] T ab556e769b194e57bb804de0e4f4b0e1 P f05528ac015e4f0cb0aa748afdc2c12e: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.003s
I20260809 12:03:31.455129 9884 tablet_bootstrap.cc:492] T ab556e769b194e57bb804de0e4f4b0e1 P e0b5e4c0505c4122ae1349ee4beb5bd1: Bootstrap starting.
I20260809 12:03:31.456100 9888 raft_consensus.cc:348] T ab556e769b194e57bb804de0e4f4b0e1 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.456329 9888 raft_consensus.cc:374] T ab556e769b194e57bb804de0e4f4b0e1 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:31.456416 9888 raft_consensus.cc:729] T ab556e769b194e57bb804de0e4f4b0e1 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f05528ac015e4f0cb0aa748afdc2c12e, State: Initialized, Role: FOLLOWER
I20260809 12:03:31.456733 9888 consensus_queue.cc:260] T ab556e769b194e57bb804de0e4f4b0e1 P f05528ac015e4f0cb0aa748afdc2c12e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.457276 9888 ts_tablet_manager.cc:1428] T ab556e769b194e57bb804de0e4f4b0e1 P f05528ac015e4f0cb0aa748afdc2c12e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260809 12:03:31.457361 9884 tablet_bootstrap.cc:654] T ab556e769b194e57bb804de0e4f4b0e1 P e0b5e4c0505c4122ae1349ee4beb5bd1: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:31.459684 9886 ts_tablet_manager.cc:1428] T 85bb8662f3174951bbdb45c8fcbaa975 P cde39fbb4ced4d049fef6754c3f3e796: Time spent starting tablet: real 0.037s user 0.015s sys 0.004s
I20260809 12:03:31.460672 9886 tablet_bootstrap.cc:492] T ab556e769b194e57bb804de0e4f4b0e1 P cde39fbb4ced4d049fef6754c3f3e796: Bootstrap starting.
I20260809 12:03:31.462903 9886 tablet_bootstrap.cc:654] T ab556e769b194e57bb804de0e4f4b0e1 P cde39fbb4ced4d049fef6754c3f3e796: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:31.466255 9884 tablet_bootstrap.cc:492] T ab556e769b194e57bb804de0e4f4b0e1 P e0b5e4c0505c4122ae1349ee4beb5bd1: No bootstrap required, opened a new log
I20260809 12:03:31.466432 9884 ts_tablet_manager.cc:1397] T ab556e769b194e57bb804de0e4f4b0e1 P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.001s
I20260809 12:03:31.467562 9884 raft_consensus.cc:348] T ab556e769b194e57bb804de0e4f4b0e1 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.467810 9884 raft_consensus.cc:374] T ab556e769b194e57bb804de0e4f4b0e1 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:31.467922 9884 raft_consensus.cc:729] T ab556e769b194e57bb804de0e4f4b0e1 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0b5e4c0505c4122ae1349ee4beb5bd1, State: Initialized, Role: FOLLOWER
I20260809 12:03:31.468256 9884 consensus_queue.cc:260] T ab556e769b194e57bb804de0e4f4b0e1 P e0b5e4c0505c4122ae1349ee4beb5bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.468927 9884 ts_tablet_manager.cc:1428] T ab556e769b194e57bb804de0e4f4b0e1 P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 12:03:31.474768 9886 tablet_bootstrap.cc:492] T ab556e769b194e57bb804de0e4f4b0e1 P cde39fbb4ced4d049fef6754c3f3e796: No bootstrap required, opened a new log
I20260809 12:03:31.474920 9886 ts_tablet_manager.cc:1397] T ab556e769b194e57bb804de0e4f4b0e1 P cde39fbb4ced4d049fef6754c3f3e796: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.011s
I20260809 12:03:31.475951 9886 raft_consensus.cc:348] T ab556e769b194e57bb804de0e4f4b0e1 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.476147 9886 raft_consensus.cc:374] T ab556e769b194e57bb804de0e4f4b0e1 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:31.476244 9886 raft_consensus.cc:729] T ab556e769b194e57bb804de0e4f4b0e1 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cde39fbb4ced4d049fef6754c3f3e796, State: Initialized, Role: FOLLOWER
I20260809 12:03:31.476547 9886 consensus_queue.cc:260] T ab556e769b194e57bb804de0e4f4b0e1 P cde39fbb4ced4d049fef6754c3f3e796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.477093 9886 ts_tablet_manager.cc:1428] T ab556e769b194e57bb804de0e4f4b0e1 P cde39fbb4ced4d049fef6754c3f3e796: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260809 12:03:31.529603 9532 tablet.cc:2369] T 85bb8662f3174951bbdb45c8fcbaa975 P cde39fbb4ced4d049fef6754c3f3e796: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:03:31.534 [HMS - ERROR - pool-6-thread-2] (RetryingHMSHandler.java:201) AlreadyExistsException(message:Table hive.default.table_badbfc92917e45a5aa60e47244ae5ff5 already exists)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:1839)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:1786)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_with_environment_context(HiveMetaStore.java:2035)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108)
at com.sun.proxy.$Proxy25.create_table_with_environment_context(Unknown Source)
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:14800)
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:14784)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:104)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
W20260809 12:03:31.537420 8909 catalog_manager.cc:2144] Already present: failed to create HMS catalog entry for table [id=3131a049660847518f6e6a40daab9024]: failed to create Hive MetaStore table: TException - service has thrown: AlreadyExistsException(message=Table hive.default.table_badbfc92917e45a5aa60e47244ae5ff5 already exists)
I20260809 12:03:31.540196 9300 heartbeater.cc:503] Master 127.8.15.124:33307 was elected leader, sending a full tablet report...
W20260809 12:03:31.540441 9312 tablet.cc:2369] T 85bb8662f3174951bbdb45c8fcbaa975 P f05528ac015e4f0cb0aa748afdc2c12e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 12:03:31.542732 9529 heartbeater.cc:503] Master 127.8.15.124:33307 was elected leader, sending a full tablet report...
I20260809 12:03:31.547366 8909 master_service.cc:946] ReplaceTablet: received request to replace tablet ab556e769b194e57bb804de0e4f4b0e1 from {username='slave'} at 127.0.0.1:59982
I20260809 12:03:31.556042 8909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: Sending DeleteTablet for 3 replicas of tablet ab556e769b194e57bb804de0e4f4b0e1
I20260809 12:03:31.557410 9200 tablet_service.cc:1514] Processing DeleteTablet for tablet ab556e769b194e57bb804de0e4f4b0e1 with delete_type TABLET_DATA_DELETED (replaced by tablet 00bb1683a9eb4a4bbd2f46044989ddeb) from {username='slave'} at 127.0.0.1:36636
I20260809 12:03:31.557410 9427 tablet_service.cc:1514] Processing DeleteTablet for tablet ab556e769b194e57bb804de0e4f4b0e1 with delete_type TABLET_DATA_DELETED (replaced by tablet 00bb1683a9eb4a4bbd2f46044989ddeb) from {username='slave'} at 127.0.0.1:45542
I20260809 12:03:31.563421 9649 tablet_service.cc:1514] Processing DeleteTablet for tablet ab556e769b194e57bb804de0e4f4b0e1 with delete_type TABLET_DATA_DELETED (replaced by tablet 00bb1683a9eb4a4bbd2f46044989ddeb) from {username='slave'} at 127.0.0.1:36266
I20260809 12:03:31.564987 8909 catalog_manager.cc:6565] ReplaceTablet: tablet ab556e769b194e57bb804de0e4f4b0e1 deleted and replaced by tablet 00bb1683a9eb4a4bbd2f46044989ddeb
I20260809 12:03:31.566603 8909 master_service.cc:946] ReplaceTablet: received request to replace tablet ab556e769b194e57bb804de0e4f4b0e1 from {username='slave'} at 127.0.0.1:59982
I20260809 12:03:31.568935 8909 master_service.cc:946] ReplaceTablet: received request to replace tablet ab556e769b194e57bb804de0e4f4b0e1 from {username='slave'} at 127.0.0.1:59982
I20260809 12:03:31.574869 9647 tablet_service.cc:1467] Processing CreateTablet for tablet 00bb1683a9eb4a4bbd2f46044989ddeb (DEFAULT_TABLE table=default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.575395 9647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00bb1683a9eb4a4bbd2f46044989ddeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.575573 9198 tablet_service.cc:1467] Processing CreateTablet for tablet 00bb1683a9eb4a4bbd2f46044989ddeb (DEFAULT_TABLE table=default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.576025 9198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00bb1683a9eb4a4bbd2f46044989ddeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.579716 9425 tablet_service.cc:1467] Processing CreateTablet for tablet 00bb1683a9eb4a4bbd2f46044989ddeb (DEFAULT_TABLE table=default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.580164 9425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00bb1683a9eb4a4bbd2f46044989ddeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.582895 9888 tablet_bootstrap.cc:492] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e: Bootstrap starting.
I20260809 12:03:31.574509 8903 catalog_manager.cc:2148] created HMS catalog entry for table [id=085a7a8b72ea4da2817e62d516fbcc38]
I20260809 12:03:31.584621 9888 tablet_bootstrap.cc:654] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:31.584656 8909 master_service.cc:946] ReplaceTablet: received request to replace tablet ab556e769b194e57bb804de0e4f4b0e1 from {username='slave'} at 127.0.0.1:59982
I20260809 12:03:31.588951 9884 tablet_bootstrap.cc:492] T 00bb1683a9eb4a4bbd2f46044989ddeb P e0b5e4c0505c4122ae1349ee4beb5bd1: Bootstrap starting.
I20260809 12:03:31.590083 9886 tablet_bootstrap.cc:492] T 00bb1683a9eb4a4bbd2f46044989ddeb P cde39fbb4ced4d049fef6754c3f3e796: Bootstrap starting.
I20260809 12:03:31.590752 9884 tablet_bootstrap.cc:654] T 00bb1683a9eb4a4bbd2f46044989ddeb P e0b5e4c0505c4122ae1349ee4beb5bd1: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:31.591718 9886 tablet_bootstrap.cc:654] T 00bb1683a9eb4a4bbd2f46044989ddeb P cde39fbb4ced4d049fef6754c3f3e796: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:31.592056 8909 master_service.cc:946] ReplaceTablet: received request to replace tablet ab556e769b194e57bb804de0e4f4b0e1 from {username='slave'} at 127.0.0.1:59982
I20260809 12:03:31.592170 8903 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59982:
name: "default.Table_32063c5c554f4148b27ed449777518f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:31.592752 8909 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59982:
name: "default.Table_98748f90a4da4969b9f519b8b02d21a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:31.596334 9913 tablet_replica.cc:330] T ab556e769b194e57bb804de0e4f4b0e1 P f05528ac015e4f0cb0aa748afdc2c12e: stopping tablet replica
I20260809 12:03:31.596724 9886 tablet_bootstrap.cc:492] T 00bb1683a9eb4a4bbd2f46044989ddeb P cde39fbb4ced4d049fef6754c3f3e796: No bootstrap required, opened a new log
I20260809 12:03:31.596913 9886 ts_tablet_manager.cc:1397] T 00bb1683a9eb4a4bbd2f46044989ddeb P cde39fbb4ced4d049fef6754c3f3e796: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260809 12:03:31.597854 9886 raft_consensus.cc:348] T 00bb1683a9eb4a4bbd2f46044989ddeb P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.598129 9886 raft_consensus.cc:374] T 00bb1683a9eb4a4bbd2f46044989ddeb P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:31.598222 9886 raft_consensus.cc:729] T 00bb1683a9eb4a4bbd2f46044989ddeb P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cde39fbb4ced4d049fef6754c3f3e796, State: Initialized, Role: FOLLOWER
I20260809 12:03:31.598510 9886 consensus_queue.cc:260] T 00bb1683a9eb4a4bbd2f46044989ddeb P cde39fbb4ced4d049fef6754c3f3e796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.599102 9886 ts_tablet_manager.cc:1428] T 00bb1683a9eb4a4bbd2f46044989ddeb P cde39fbb4ced4d049fef6754c3f3e796: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 12:03:31.604903 9200 tablet_service.cc:1467] Processing CreateTablet for tablet 75a3c4f588b148d998eec3f308e46cea (DEFAULT_TABLE table=default.table_da029d70439d48cc842a66906f93d903 [id=085a7a8b72ea4da2817e62d516fbcc38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.605397 9200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75a3c4f588b148d998eec3f308e46cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.605979 9425 tablet_service.cc:1467] Processing CreateTablet for tablet 75a3c4f588b148d998eec3f308e46cea (DEFAULT_TABLE table=default.table_da029d70439d48cc842a66906f93d903 [id=085a7a8b72ea4da2817e62d516fbcc38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.606596 9647 tablet_service.cc:1467] Processing CreateTablet for tablet 75a3c4f588b148d998eec3f308e46cea (DEFAULT_TABLE table=default.table_da029d70439d48cc842a66906f93d903 [id=085a7a8b72ea4da2817e62d516fbcc38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.607120 9425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75a3c4f588b148d998eec3f308e46cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.607573 9647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75a3c4f588b148d998eec3f308e46cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.607983 9913 raft_consensus.cc:2229] T ab556e769b194e57bb804de0e4f4b0e1 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Raft consensus shutting down.
I20260809 12:03:31.608522 9913 raft_consensus.cc:2258] T ab556e769b194e57bb804de0e4f4b0e1 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:31.609965 9888 tablet_bootstrap.cc:492] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e: No bootstrap required, opened a new log
I20260809 12:03:31.610167 9888 ts_tablet_manager.cc:1397] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e: Time spent bootstrapping tablet: real 0.027s user 0.007s sys 0.003s
I20260809 12:03:31.611140 9888 raft_consensus.cc:348] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.611442 9888 raft_consensus.cc:374] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:31.611521 9888 raft_consensus.cc:729] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f05528ac015e4f0cb0aa748afdc2c12e, State: Initialized, Role: FOLLOWER
I20260809 12:03:31.611819 9888 consensus_queue.cc:260] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.616364 9888 ts_tablet_manager.cc:1428] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260809 12:03:31.617810 9911 tablet_replica.cc:330] T ab556e769b194e57bb804de0e4f4b0e1 P cde39fbb4ced4d049fef6754c3f3e796: stopping tablet replica
I20260809 12:03:31.621678 9911 raft_consensus.cc:2229] T ab556e769b194e57bb804de0e4f4b0e1 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260809 12:03:31.622706 9913 ts_tablet_manager.cc:1905] T ab556e769b194e57bb804de0e4f4b0e1 P f05528ac015e4f0cb0aa748afdc2c12e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:31.623111 9886 tablet_bootstrap.cc:492] T 75a3c4f588b148d998eec3f308e46cea P cde39fbb4ced4d049fef6754c3f3e796: Bootstrap starting.
I20260809 12:03:31.623158 9884 tablet_bootstrap.cc:492] T 00bb1683a9eb4a4bbd2f46044989ddeb P e0b5e4c0505c4122ae1349ee4beb5bd1: No bootstrap required, opened a new log
I20260809 12:03:31.623365 9884 ts_tablet_manager.cc:1397] T 00bb1683a9eb4a4bbd2f46044989ddeb P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.003s
I20260809 12:03:31.624190 9888 tablet_bootstrap.cc:492] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e: Bootstrap starting.
I20260809 12:03:31.624203 9884 raft_consensus.cc:348] T 00bb1683a9eb4a4bbd2f46044989ddeb P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.624464 9884 raft_consensus.cc:374] T 00bb1683a9eb4a4bbd2f46044989ddeb P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:31.624547 9884 raft_consensus.cc:729] T 00bb1683a9eb4a4bbd2f46044989ddeb P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0b5e4c0505c4122ae1349ee4beb5bd1, State: Initialized, Role: FOLLOWER
I20260809 12:03:31.624802 9886 tablet_bootstrap.cc:654] T 75a3c4f588b148d998eec3f308e46cea P cde39fbb4ced4d049fef6754c3f3e796: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:31.624815 9884 consensus_queue.cc:260] T 00bb1683a9eb4a4bbd2f46044989ddeb P e0b5e4c0505c4122ae1349ee4beb5bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.625396 9884 ts_tablet_manager.cc:1428] T 00bb1683a9eb4a4bbd2f46044989ddeb P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 12:03:31.625723 9888 tablet_bootstrap.cc:654] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:31.629612 9884 tablet_bootstrap.cc:492] T 75a3c4f588b148d998eec3f308e46cea P e0b5e4c0505c4122ae1349ee4beb5bd1: Bootstrap starting.
I20260809 12:03:31.631500 9884 tablet_bootstrap.cc:654] T 75a3c4f588b148d998eec3f308e46cea P e0b5e4c0505c4122ae1349ee4beb5bd1: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:31.634967 9886 tablet_bootstrap.cc:492] T 75a3c4f588b148d998eec3f308e46cea P cde39fbb4ced4d049fef6754c3f3e796: No bootstrap required, opened a new log
I20260809 12:03:31.635221 9886 ts_tablet_manager.cc:1397] T 75a3c4f588b148d998eec3f308e46cea P cde39fbb4ced4d049fef6754c3f3e796: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20260809 12:03:31.635457 8904 catalog_manager.cc:2148] created HMS catalog entry for table [id=325c41115c9d4a16820f3f3e2c53ab6b]
I20260809 12:03:31.636157 9886 raft_consensus.cc:348] T 75a3c4f588b148d998eec3f308e46cea P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.636421 9886 raft_consensus.cc:374] T 75a3c4f588b148d998eec3f308e46cea P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:31.636514 9886 raft_consensus.cc:729] T 75a3c4f588b148d998eec3f308e46cea P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cde39fbb4ced4d049fef6754c3f3e796, State: Initialized, Role: FOLLOWER
I20260809 12:03:31.636782 9886 consensus_queue.cc:260] T 75a3c4f588b148d998eec3f308e46cea P cde39fbb4ced4d049fef6754c3f3e796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.640463 9886 ts_tablet_manager.cc:1428] T 75a3c4f588b148d998eec3f308e46cea P cde39fbb4ced4d049fef6754c3f3e796: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260809 12:03:31.643603 9888 tablet_bootstrap.cc:492] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e: No bootstrap required, opened a new log
I20260809 12:03:31.643829 9888 ts_tablet_manager.cc:1397] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.006s
I20260809 12:03:31.644111 9911 raft_consensus.cc:2258] T ab556e769b194e57bb804de0e4f4b0e1 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:31.644752 9888 raft_consensus.cc:348] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.645074 9888 raft_consensus.cc:374] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:31.645217 9888 raft_consensus.cc:729] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f05528ac015e4f0cb0aa748afdc2c12e, State: Initialized, Role: FOLLOWER
I20260809 12:03:31.645536 9888 consensus_queue.cc:260] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.646256 9911 ts_tablet_manager.cc:1905] T ab556e769b194e57bb804de0e4f4b0e1 P cde39fbb4ced4d049fef6754c3f3e796: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:31.651736 9915 tablet_replica.cc:330] T ab556e769b194e57bb804de0e4f4b0e1 P e0b5e4c0505c4122ae1349ee4beb5bd1: stopping tablet replica
I20260809 12:03:31.651739 9888 ts_tablet_manager.cc:1428] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260809 12:03:31.645674 9913 ts_tablet_manager.cc:1918] T ab556e769b194e57bb804de0e4f4b0e1 P f05528ac015e4f0cb0aa748afdc2c12e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260809 12:03:31.652051 9913 log.cc:1196] T ab556e769b194e57bb804de0e4f4b0e1 P f05528ac015e4f0cb0aa748afdc2c12e: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/wal/wals/ab556e769b194e57bb804de0e4f4b0e1
I20260809 12:03:31.652272 9915 raft_consensus.cc:2229] T ab556e769b194e57bb804de0e4f4b0e1 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260809 12:03:31.652639 9913 ts_tablet_manager.cc:1939] T ab556e769b194e57bb804de0e4f4b0e1 P f05528ac015e4f0cb0aa748afdc2c12e: Deleting consensus metadata
I20260809 12:03:31.652729 9915 raft_consensus.cc:2258] T ab556e769b194e57bb804de0e4f4b0e1 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:31.654857 8895 catalog_manager.cc:4841] TS f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): tablet ab556e769b194e57bb804de0e4f4b0e1 (table default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf]) successfully deleted
I20260809 12:03:31.655316 9911 ts_tablet_manager.cc:1918] T ab556e769b194e57bb804de0e4f4b0e1 P cde39fbb4ced4d049fef6754c3f3e796: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260809 12:03:31.655346 9915 ts_tablet_manager.cc:1905] T ab556e769b194e57bb804de0e4f4b0e1 P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:31.655512 9911 log.cc:1196] T ab556e769b194e57bb804de0e4f4b0e1 P cde39fbb4ced4d049fef6754c3f3e796: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/wal/wals/ab556e769b194e57bb804de0e4f4b0e1
I20260809 12:03:31.655961 9911 ts_tablet_manager.cc:1939] T ab556e769b194e57bb804de0e4f4b0e1 P cde39fbb4ced4d049fef6754c3f3e796: Deleting consensus metadata
I20260809 12:03:31.658135 9649 tablet_service.cc:1467] Processing CreateTablet for tablet 67e9ded6eae9402a873f21c7219fed24 (DEFAULT_TABLE table=default.table_8ccd04aad0ba4f5480308b917eb8a12e [id=325c41115c9d4a16820f3f3e2c53ab6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.658591 9649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67e9ded6eae9402a873f21c7219fed24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.659531 8904 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59982:
name: "default.Table_a20494e2c08645f2b8321fd1681d3551"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:31.660638 9884 tablet_bootstrap.cc:492] T 75a3c4f588b148d998eec3f308e46cea P e0b5e4c0505c4122ae1349ee4beb5bd1: No bootstrap required, opened a new log
I20260809 12:03:31.660815 9884 ts_tablet_manager.cc:1397] T 75a3c4f588b148d998eec3f308e46cea P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.007s
I20260809 12:03:31.661231 9425 tablet_service.cc:1467] Processing CreateTablet for tablet 67e9ded6eae9402a873f21c7219fed24 (DEFAULT_TABLE table=default.table_8ccd04aad0ba4f5480308b917eb8a12e [id=325c41115c9d4a16820f3f3e2c53ab6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.661629 9425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67e9ded6eae9402a873f21c7219fed24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.661661 9884 raft_consensus.cc:348] T 75a3c4f588b148d998eec3f308e46cea P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.661891 9884 raft_consensus.cc:374] T 75a3c4f588b148d998eec3f308e46cea P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:31.662004 9884 raft_consensus.cc:729] T 75a3c4f588b148d998eec3f308e46cea P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0b5e4c0505c4122ae1349ee4beb5bd1, State: Initialized, Role: FOLLOWER
I20260809 12:03:31.662148 9915 ts_tablet_manager.cc:1918] T ab556e769b194e57bb804de0e4f4b0e1 P e0b5e4c0505c4122ae1349ee4beb5bd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260809 12:03:31.662318 9915 log.cc:1196] T ab556e769b194e57bb804de0e4f4b0e1 P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/wal/wals/ab556e769b194e57bb804de0e4f4b0e1
I20260809 12:03:31.662249 9884 consensus_queue.cc:260] T 75a3c4f588b148d998eec3f308e46cea P e0b5e4c0505c4122ae1349ee4beb5bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.662909 9884 ts_tablet_manager.cc:1428] T 75a3c4f588b148d998eec3f308e46cea P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260809 12:03:31.665594 9884 tablet_bootstrap.cc:492] T 67e9ded6eae9402a873f21c7219fed24 P e0b5e4c0505c4122ae1349ee4beb5bd1: Bootstrap starting.
I20260809 12:03:31.666028 8896 catalog_manager.cc:4841] TS cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): tablet ab556e769b194e57bb804de0e4f4b0e1 (table default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf]) successfully deleted
I20260809 12:03:31.667632 9915 ts_tablet_manager.cc:1939] T ab556e769b194e57bb804de0e4f4b0e1 P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting consensus metadata
W20260809 12:03:31.669353 9768 tablet.cc:2369] T 00bb1683a9eb4a4bbd2f46044989ddeb P e0b5e4c0505c4122ae1349ee4beb5bd1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 12:03:31.669508 8897 catalog_manager.cc:4841] TS e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793): tablet ab556e769b194e57bb804de0e4f4b0e1 (table default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf]) successfully deleted
I20260809 12:03:31.670142 9884 tablet_bootstrap.cc:654] T 67e9ded6eae9402a873f21c7219fed24 P e0b5e4c0505c4122ae1349ee4beb5bd1: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:31.670253 9200 tablet_service.cc:1467] Processing CreateTablet for tablet 67e9ded6eae9402a873f21c7219fed24 (DEFAULT_TABLE table=default.table_8ccd04aad0ba4f5480308b917eb8a12e [id=325c41115c9d4a16820f3f3e2c53ab6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.670718 9200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67e9ded6eae9402a873f21c7219fed24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.672956 9886 tablet_bootstrap.cc:492] T 67e9ded6eae9402a873f21c7219fed24 P cde39fbb4ced4d049fef6754c3f3e796: Bootstrap starting.
I20260809 12:03:31.674531 9886 tablet_bootstrap.cc:654] T 67e9ded6eae9402a873f21c7219fed24 P cde39fbb4ced4d049fef6754c3f3e796: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:31.677965 9888 tablet_bootstrap.cc:492] T 67e9ded6eae9402a873f21c7219fed24 P f05528ac015e4f0cb0aa748afdc2c12e: Bootstrap starting.
I20260809 12:03:31.678380 9884 tablet_bootstrap.cc:492] T 67e9ded6eae9402a873f21c7219fed24 P e0b5e4c0505c4122ae1349ee4beb5bd1: No bootstrap required, opened a new log
I20260809 12:03:31.678552 9884 ts_tablet_manager.cc:1397] T 67e9ded6eae9402a873f21c7219fed24 P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.003s
I20260809 12:03:31.679339 9884 raft_consensus.cc:348] T 67e9ded6eae9402a873f21c7219fed24 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.679569 9888 tablet_bootstrap.cc:654] T 67e9ded6eae9402a873f21c7219fed24 P f05528ac015e4f0cb0aa748afdc2c12e: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:31.679600 9884 raft_consensus.cc:374] T 67e9ded6eae9402a873f21c7219fed24 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:31.679683 9884 raft_consensus.cc:729] T 67e9ded6eae9402a873f21c7219fed24 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0b5e4c0505c4122ae1349ee4beb5bd1, State: Initialized, Role: FOLLOWER
I20260809 12:03:31.679963 9884 consensus_queue.cc:260] T 67e9ded6eae9402a873f21c7219fed24 P e0b5e4c0505c4122ae1349ee4beb5bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.682437 9884 ts_tablet_manager.cc:1428] T 67e9ded6eae9402a873f21c7219fed24 P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260809 12:03:31.686357 9888 tablet_bootstrap.cc:492] T 67e9ded6eae9402a873f21c7219fed24 P f05528ac015e4f0cb0aa748afdc2c12e: No bootstrap required, opened a new log
I20260809 12:03:31.686534 9888 ts_tablet_manager.cc:1397] T 67e9ded6eae9402a873f21c7219fed24 P f05528ac015e4f0cb0aa748afdc2c12e: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260809 12:03:31.686856 9886 tablet_bootstrap.cc:492] T 67e9ded6eae9402a873f21c7219fed24 P cde39fbb4ced4d049fef6754c3f3e796: No bootstrap required, opened a new log
I20260809 12:03:31.687021 9886 ts_tablet_manager.cc:1397] T 67e9ded6eae9402a873f21c7219fed24 P cde39fbb4ced4d049fef6754c3f3e796: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.002s
I20260809 12:03:31.687229 9888 raft_consensus.cc:348] T 67e9ded6eae9402a873f21c7219fed24 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.687489 9888 raft_consensus.cc:374] T 67e9ded6eae9402a873f21c7219fed24 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:31.687567 9888 raft_consensus.cc:729] T 67e9ded6eae9402a873f21c7219fed24 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f05528ac015e4f0cb0aa748afdc2c12e, State: Initialized, Role: FOLLOWER
I20260809 12:03:31.687800 9888 consensus_queue.cc:260] T 67e9ded6eae9402a873f21c7219fed24 P f05528ac015e4f0cb0aa748afdc2c12e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.688297 9888 ts_tablet_manager.cc:1428] T 67e9ded6eae9402a873f21c7219fed24 P f05528ac015e4f0cb0aa748afdc2c12e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 12:03:31.687844 9886 raft_consensus.cc:348] T 67e9ded6eae9402a873f21c7219fed24 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.689901 9886 raft_consensus.cc:374] T 67e9ded6eae9402a873f21c7219fed24 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:31.690012 9886 raft_consensus.cc:729] T 67e9ded6eae9402a873f21c7219fed24 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cde39fbb4ced4d049fef6754c3f3e796, State: Initialized, Role: FOLLOWER
I20260809 12:03:31.690330 9886 consensus_queue.cc:260] T 67e9ded6eae9402a873f21c7219fed24 P cde39fbb4ced4d049fef6754c3f3e796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.695017 9886 ts_tablet_manager.cc:1428] T 67e9ded6eae9402a873f21c7219fed24 P cde39fbb4ced4d049fef6754c3f3e796: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260809 12:03:31.722627 8905 catalog_manager.cc:2148] created HMS catalog entry for table [id=87a2e7cf29fa4fdc8d5ea2173cdc1c2d]
I20260809 12:03:31.732127 8905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59982:
table { table_name: "default.Table_da029d70439d48cc842a66906f93d903" } new_table_name: "default.Table_4bc23e8b582a43d38648468e3b9f8237" modify_external_catalogs: true
I20260809 12:03:31.744711 9649 tablet_service.cc:1467] Processing CreateTablet for tablet c755c68ccba04ded80a352012364af5b (DEFAULT_TABLE table=default.table_939805886d394093ad5a402efa777cb4 [id=87a2e7cf29fa4fdc8d5ea2173cdc1c2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.744963 9425 tablet_service.cc:1467] Processing CreateTablet for tablet c755c68ccba04ded80a352012364af5b (DEFAULT_TABLE table=default.table_939805886d394093ad5a402efa777cb4 [id=87a2e7cf29fa4fdc8d5ea2173cdc1c2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.745244 9649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c755c68ccba04ded80a352012364af5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.745419 9425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c755c68ccba04ded80a352012364af5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.747655 9200 tablet_service.cc:1467] Processing CreateTablet for tablet c755c68ccba04ded80a352012364af5b (DEFAULT_TABLE table=default.table_939805886d394093ad5a402efa777cb4 [id=87a2e7cf29fa4fdc8d5ea2173cdc1c2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.748147 9200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c755c68ccba04ded80a352012364af5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.751896 9884 tablet_bootstrap.cc:492] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1: Bootstrap starting.
I20260809 12:03:31.753254 9884 tablet_bootstrap.cc:654] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:31.755195 9884 tablet_bootstrap.cc:492] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1: No bootstrap required, opened a new log
I20260809 12:03:31.755378 9884 ts_tablet_manager.cc:1397] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20260809 12:03:31.755975 9884 raft_consensus.cc:348] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } }
I20260809 12:03:31.756172 9884 raft_consensus.cc:374] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:31.756263 9884 raft_consensus.cc:729] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0b5e4c0505c4122ae1349ee4beb5bd1, State: Initialized, Role: FOLLOWER
I20260809 12:03:31.756490 9884 consensus_queue.cc:260] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } }
I20260809 12:03:31.756963 9896 raft_consensus.cc:482] T 67e9ded6eae9402a873f21c7219fed24 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:31.757304 9896 raft_consensus.cc:504] T 67e9ded6eae9402a873f21c7219fed24 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.758275 9884 ts_tablet_manager.cc:1428] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260809 12:03:31.759624 9896 leader_election.cc:288] T 67e9ded6eae9402a873f21c7219fed24 P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:31.760123 9888 tablet_bootstrap.cc:492] T c755c68ccba04ded80a352012364af5b P f05528ac015e4f0cb0aa748afdc2c12e: Bootstrap starting.
I20260809 12:03:31.761840 9888 tablet_bootstrap.cc:654] T c755c68ccba04ded80a352012364af5b P f05528ac015e4f0cb0aa748afdc2c12e: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:31.768419 8907 catalog_manager.cc:2148] created HMS catalog entry for table [id=78883a236d6b4026a725d3a3cc60dec1]
I20260809 12:03:31.778582 9465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67e9ded6eae9402a873f21c7219fed24" candidate_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde39fbb4ced4d049fef6754c3f3e796" is_pre_election: true
I20260809 12:03:31.779183 9465 raft_consensus.cc:2454] T 67e9ded6eae9402a873f21c7219fed24 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f05528ac015e4f0cb0aa748afdc2c12e in term 0.
I20260809 12:03:31.780189 9125 leader_election.cc:302] T 67e9ded6eae9402a873f21c7219fed24 P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e; no voters:
I20260809 12:03:31.780227 9681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67e9ded6eae9402a873f21c7219fed24" candidate_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" is_pre_election: true
I20260809 12:03:31.780781 9681 raft_consensus.cc:2454] T 67e9ded6eae9402a873f21c7219fed24 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f05528ac015e4f0cb0aa748afdc2c12e in term 0.
I20260809 12:03:31.788431 9886 tablet_bootstrap.cc:492] T c755c68ccba04ded80a352012364af5b P cde39fbb4ced4d049fef6754c3f3e796: Bootstrap starting.
I20260809 12:03:31.790006 8907 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59982:
table { table_name: "default.Table_8ccd04aad0ba4f5480308b917eb8a12e" } new_table_name: "default.Table_489095aac0bc4bfaa46526a3f3a1f487" modify_external_catalogs: true
I20260809 12:03:31.790340 9886 tablet_bootstrap.cc:654] T c755c68ccba04ded80a352012364af5b P cde39fbb4ced4d049fef6754c3f3e796: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:31.791898 9427 tablet_service.cc:1467] Processing CreateTablet for tablet 12eb84afa6ce467989205478da21f1bf (DEFAULT_TABLE table=default.table_520e75ee39c74e6985dbd81c6f2e32f8 [id=78883a236d6b4026a725d3a3cc60dec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.792179 9888 tablet_bootstrap.cc:492] T c755c68ccba04ded80a352012364af5b P f05528ac015e4f0cb0aa748afdc2c12e: No bootstrap required, opened a new log
I20260809 12:03:31.792332 9427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12eb84afa6ce467989205478da21f1bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.792331 9888 ts_tablet_manager.cc:1397] T c755c68ccba04ded80a352012364af5b P f05528ac015e4f0cb0aa748afdc2c12e: Time spent bootstrapping tablet: real 0.032s user 0.007s sys 0.003s
I20260809 12:03:31.792377 9649 tablet_service.cc:1467] Processing CreateTablet for tablet 12eb84afa6ce467989205478da21f1bf (DEFAULT_TABLE table=default.table_520e75ee39c74e6985dbd81c6f2e32f8 [id=78883a236d6b4026a725d3a3cc60dec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.792817 9649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12eb84afa6ce467989205478da21f1bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.793125 9888 raft_consensus.cc:348] T c755c68ccba04ded80a352012364af5b P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } }
I20260809 12:03:31.793346 9888 raft_consensus.cc:374] T c755c68ccba04ded80a352012364af5b P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:31.793432 9888 raft_consensus.cc:729] T c755c68ccba04ded80a352012364af5b P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f05528ac015e4f0cb0aa748afdc2c12e, State: Initialized, Role: FOLLOWER
I20260809 12:03:31.793656 9888 consensus_queue.cc:260] T c755c68ccba04ded80a352012364af5b P f05528ac015e4f0cb0aa748afdc2c12e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } }
I20260809 12:03:31.796116 9896 raft_consensus.cc:482] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:31.796280 9896 raft_consensus.cc:504] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.796900 9896 leader_election.cc:288] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:31.797122 9896 raft_consensus.cc:2781] T 67e9ded6eae9402a873f21c7219fed24 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 12:03:31.797278 9896 raft_consensus.cc:482] T 67e9ded6eae9402a873f21c7219fed24 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 12:03:31.797395 9896 raft_consensus.cc:3037] T 67e9ded6eae9402a873f21c7219fed24 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:31.799852 9681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00bb1683a9eb4a4bbd2f46044989ddeb" candidate_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" is_pre_election: true
I20260809 12:03:31.800089 9681 raft_consensus.cc:2454] T 00bb1683a9eb4a4bbd2f46044989ddeb P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f05528ac015e4f0cb0aa748afdc2c12e in term 0.
I20260809 12:03:31.800554 9127 leader_election.cc:302] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1, f05528ac015e4f0cb0aa748afdc2c12e; no voters:
I20260809 12:03:31.803804 9937 raft_consensus.cc:2781] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 12:03:31.803934 9937 raft_consensus.cc:482] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 12:03:31.804080 9937 raft_consensus.cc:3037] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:31.806177 9888 ts_tablet_manager.cc:1428] T c755c68ccba04ded80a352012364af5b P f05528ac015e4f0cb0aa748afdc2c12e: Time spent starting tablet: real 0.014s user 0.003s sys 0.002s
I20260809 12:03:31.811517 9937 raft_consensus.cc:504] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.812745 9681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00bb1683a9eb4a4bbd2f46044989ddeb" candidate_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1"
I20260809 12:03:31.812979 9681 raft_consensus.cc:3037] T 00bb1683a9eb4a4bbd2f46044989ddeb P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:31.816126 9681 raft_consensus.cc:2454] T 00bb1683a9eb4a4bbd2f46044989ddeb P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f05528ac015e4f0cb0aa748afdc2c12e in term 1.
I20260809 12:03:31.816620 9127 leader_election.cc:302] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1, f05528ac015e4f0cb0aa748afdc2c12e; no voters:
I20260809 12:03:31.819772 9884 tablet_bootstrap.cc:492] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1: Bootstrap starting.
I20260809 12:03:31.820335 9896 raft_consensus.cc:504] T 67e9ded6eae9402a873f21c7219fed24 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.821561 9884 tablet_bootstrap.cc:654] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:31.821498 9681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67e9ded6eae9402a873f21c7219fed24" candidate_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1"
I20260809 12:03:31.821720 9681 raft_consensus.cc:3037] T 67e9ded6eae9402a873f21c7219fed24 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:31.823544 9886 tablet_bootstrap.cc:492] T c755c68ccba04ded80a352012364af5b P cde39fbb4ced4d049fef6754c3f3e796: No bootstrap required, opened a new log
I20260809 12:03:31.823799 9886 ts_tablet_manager.cc:1397] T c755c68ccba04ded80a352012364af5b P cde39fbb4ced4d049fef6754c3f3e796: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.008s
I20260809 12:03:31.824560 9681 raft_consensus.cc:2454] T 67e9ded6eae9402a873f21c7219fed24 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f05528ac015e4f0cb0aa748afdc2c12e in term 1.
I20260809 12:03:31.824748 9886 raft_consensus.cc:348] T c755c68ccba04ded80a352012364af5b P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } }
I20260809 12:03:31.825054 9886 raft_consensus.cc:374] T c755c68ccba04ded80a352012364af5b P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:31.825074 9127 leader_election.cc:302] T 67e9ded6eae9402a873f21c7219fed24 P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1, f05528ac015e4f0cb0aa748afdc2c12e; no voters:
I20260809 12:03:31.825263 9886 raft_consensus.cc:729] T c755c68ccba04ded80a352012364af5b P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cde39fbb4ced4d049fef6754c3f3e796, State: Initialized, Role: FOLLOWER
I20260809 12:03:31.825606 9886 consensus_queue.cc:260] T c755c68ccba04ded80a352012364af5b P cde39fbb4ced4d049fef6754c3f3e796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } }
I20260809 12:03:31.827553 8908 catalog_manager.cc:2148] created HMS catalog entry for table [id=5239b7194cf944d881c8c4b6113b0dfa]
I20260809 12:03:31.827780 9937 leader_election.cc:288] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 election: Requested vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:31.827965 9937 raft_consensus.cc:2781] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 12:03:31.828109 9937 raft_consensus.cc:686] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e [term 1 LEADER]: Becoming Leader. State: Replica: f05528ac015e4f0cb0aa748afdc2c12e, State: Running, Role: LEADER
I20260809 12:03:31.828521 9937 consensus_queue.cc:237] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.830871 9886 ts_tablet_manager.cc:1428] T c755c68ccba04ded80a352012364af5b P cde39fbb4ced4d049fef6754c3f3e796: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260809 12:03:31.837211 9896 leader_election.cc:288] T 67e9ded6eae9402a873f21c7219fed24 P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 election: Requested vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:31.838511 9886 tablet_bootstrap.cc:492] T 12eb84afa6ce467989205478da21f1bf P cde39fbb4ced4d049fef6754c3f3e796: Bootstrap starting.
I20260809 12:03:31.841560 9886 tablet_bootstrap.cc:654] T 12eb84afa6ce467989205478da21f1bf P cde39fbb4ced4d049fef6754c3f3e796: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:31.842418 9647 tablet_service.cc:1467] Processing CreateTablet for tablet 37059914646d4ae09e036e9ceaad2b11 (DEFAULT_TABLE table=default.table_e97f6ba8b3354e24926902268c43a5e3 [id=5239b7194cf944d881c8c4b6113b0dfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.842905 9647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37059914646d4ae09e036e9ceaad2b11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.842310 9425 tablet_service.cc:1467] Processing CreateTablet for tablet 37059914646d4ae09e036e9ceaad2b11 (DEFAULT_TABLE table=default.table_e97f6ba8b3354e24926902268c43a5e3 [id=5239b7194cf944d881c8c4b6113b0dfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.843664 9425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37059914646d4ae09e036e9ceaad2b11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.843909 8908 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59982:
table { table_name: "default.Table_939805886d394093ad5a402efa777cb4" } new_table_name: "default.Table_fde2047ff905432799357dc11e5e179a" modify_external_catalogs: true
I20260809 12:03:31.858361 9886 tablet_bootstrap.cc:492] T 12eb84afa6ce467989205478da21f1bf P cde39fbb4ced4d049fef6754c3f3e796: No bootstrap required, opened a new log
I20260809 12:03:31.858630 9886 ts_tablet_manager.cc:1397] T 12eb84afa6ce467989205478da21f1bf P cde39fbb4ced4d049fef6754c3f3e796: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.002s
I20260809 12:03:31.859786 9886 raft_consensus.cc:348] T 12eb84afa6ce467989205478da21f1bf P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.860105 9886 raft_consensus.cc:374] T 12eb84afa6ce467989205478da21f1bf P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:31.860258 9886 raft_consensus.cc:729] T 12eb84afa6ce467989205478da21f1bf P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cde39fbb4ced4d049fef6754c3f3e796, State: Initialized, Role: FOLLOWER
I20260809 12:03:31.837440 9896 raft_consensus.cc:2781] T 67e9ded6eae9402a873f21c7219fed24 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 12:03:31.861544 9896 raft_consensus.cc:686] T 67e9ded6eae9402a873f21c7219fed24 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 LEADER]: Becoming Leader. State: Replica: f05528ac015e4f0cb0aa748afdc2c12e, State: Running, Role: LEADER
I20260809 12:03:31.861876 9896 consensus_queue.cc:237] T 67e9ded6eae9402a873f21c7219fed24 P f05528ac015e4f0cb0aa748afdc2c12e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.867982 9886 consensus_queue.cc:260] T 12eb84afa6ce467989205478da21f1bf P cde39fbb4ced4d049fef6754c3f3e796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
W20260809 12:03:31.873641 9125 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.15.66:41479, user_credentials={real_user=slave}} blocked reactor thread for 93512.6us
I20260809 12:03:31.874832 9465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00bb1683a9eb4a4bbd2f46044989ddeb" candidate_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde39fbb4ced4d049fef6754c3f3e796" is_pre_election: true
I20260809 12:03:31.875133 9465 raft_consensus.cc:2454] T 00bb1683a9eb4a4bbd2f46044989ddeb P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f05528ac015e4f0cb0aa748afdc2c12e in term 0.
I20260809 12:03:31.876904 9465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00bb1683a9eb4a4bbd2f46044989ddeb" candidate_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde39fbb4ced4d049fef6754c3f3e796"
I20260809 12:03:31.877139 9465 raft_consensus.cc:3037] T 00bb1683a9eb4a4bbd2f46044989ddeb P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Advancing to term 1
W20260809 12:03:31.878964 9127 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.15.67:34793, user_credentials={real_user=slave}} blocked reactor thread for 53930.2us
I20260809 12:03:31.882011 9465 raft_consensus.cc:2454] T 00bb1683a9eb4a4bbd2f46044989ddeb P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f05528ac015e4f0cb0aa748afdc2c12e in term 1.
I20260809 12:03:31.883738 9465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67e9ded6eae9402a873f21c7219fed24" candidate_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde39fbb4ced4d049fef6754c3f3e796"
I20260809 12:03:31.883996 9465 raft_consensus.cc:3037] T 67e9ded6eae9402a873f21c7219fed24 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:31.885664 9884 tablet_bootstrap.cc:492] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1: No bootstrap required, opened a new log
I20260809 12:03:31.885859 9884 ts_tablet_manager.cc:1397] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent bootstrapping tablet: real 0.066s user 0.008s sys 0.005s
I20260809 12:03:31.886775 9465 raft_consensus.cc:2454] T 67e9ded6eae9402a873f21c7219fed24 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f05528ac015e4f0cb0aa748afdc2c12e in term 1.
I20260809 12:03:31.886781 9884 raft_consensus.cc:348] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.887063 9884 raft_consensus.cc:374] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:31.887152 9884 raft_consensus.cc:729] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0b5e4c0505c4122ae1349ee4beb5bd1, State: Initialized, Role: FOLLOWER
I20260809 12:03:31.887486 9884 consensus_queue.cc:260] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.887774 9200 tablet_service.cc:1467] Processing CreateTablet for tablet 12eb84afa6ce467989205478da21f1bf (DEFAULT_TABLE table=default.table_520e75ee39c74e6985dbd81c6f2e32f8 [id=78883a236d6b4026a725d3a3cc60dec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.887825 9198 tablet_service.cc:1467] Processing CreateTablet for tablet 37059914646d4ae09e036e9ceaad2b11 (DEFAULT_TABLE table=default.table_e97f6ba8b3354e24926902268c43a5e3 [id=5239b7194cf944d881c8c4b6113b0dfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.888098 9884 ts_tablet_manager.cc:1428] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 12:03:31.888298 9200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12eb84afa6ce467989205478da21f1bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.888705 9198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37059914646d4ae09e036e9ceaad2b11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.891018 9884 tablet_bootstrap.cc:492] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1: Bootstrap starting.
I20260809 12:03:31.892216 8913 catalog_manager.cc:2148] created HMS catalog entry for table [id=6999f70d421f4417b855c361afdebc21]
I20260809 12:03:31.893292 9884 tablet_bootstrap.cc:654] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:31.897884 9886 ts_tablet_manager.cc:1428] T 12eb84afa6ce467989205478da21f1bf P cde39fbb4ced4d049fef6754c3f3e796: Time spent starting tablet: real 0.039s user 0.002s sys 0.001s
I20260809 12:03:31.900694 9886 tablet_bootstrap.cc:492] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796: Bootstrap starting.
I20260809 12:03:31.903757 9886 tablet_bootstrap.cc:654] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:31.906944 9888 tablet_bootstrap.cc:492] T 37059914646d4ae09e036e9ceaad2b11 P f05528ac015e4f0cb0aa748afdc2c12e: Bootstrap starting.
I20260809 12:03:31.909148 9888 tablet_bootstrap.cc:654] T 37059914646d4ae09e036e9ceaad2b11 P f05528ac015e4f0cb0aa748afdc2c12e: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:31.911610 9198 tablet_service.cc:1467] Processing CreateTablet for tablet 557cb8ac83f9476db501304e6024b0f0 (DEFAULT_TABLE table=default.table_22580336a00e422aab032707ca16836e [id=6999f70d421f4417b855c361afdebc21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.912058 9198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 557cb8ac83f9476db501304e6024b0f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.911862 8913 catalog_manager.cc:5495] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e reported cstate change: term changed from 0 to 1, leader changed from <none> to f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65). New cstate: current_term: 1 leader_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260809 12:03:31.913676 8913 catalog_manager.cc:5495] T 67e9ded6eae9402a873f21c7219fed24 P f05528ac015e4f0cb0aa748afdc2c12e reported cstate change: term changed from 0 to 1, leader changed from <none> to f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65). New cstate: current_term: 1 leader_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260809 12:03:31.917373 9649 tablet_service.cc:1467] Processing CreateTablet for tablet 557cb8ac83f9476db501304e6024b0f0 (DEFAULT_TABLE table=default.table_22580336a00e422aab032707ca16836e [id=6999f70d421f4417b855c361afdebc21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.918045 9649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 557cb8ac83f9476db501304e6024b0f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.918514 9884 tablet_bootstrap.cc:492] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1: No bootstrap required, opened a new log
I20260809 12:03:31.918700 9884 ts_tablet_manager.cc:1397] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.003s
I20260809 12:03:31.919775 9884 raft_consensus.cc:348] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.920074 9884 raft_consensus.cc:374] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:31.920217 9884 raft_consensus.cc:729] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0b5e4c0505c4122ae1349ee4beb5bd1, State: Initialized, Role: FOLLOWER
I20260809 12:03:31.920536 9884 consensus_queue.cc:260] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.921355 9888 tablet_bootstrap.cc:492] T 37059914646d4ae09e036e9ceaad2b11 P f05528ac015e4f0cb0aa748afdc2c12e: No bootstrap required, opened a new log
I20260809 12:03:31.921595 9888 ts_tablet_manager.cc:1397] T 37059914646d4ae09e036e9ceaad2b11 P f05528ac015e4f0cb0aa748afdc2c12e: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.002s
I20260809 12:03:31.922485 9888 raft_consensus.cc:348] T 37059914646d4ae09e036e9ceaad2b11 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.922886 9888 raft_consensus.cc:374] T 37059914646d4ae09e036e9ceaad2b11 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:31.923059 9888 raft_consensus.cc:729] T 37059914646d4ae09e036e9ceaad2b11 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f05528ac015e4f0cb0aa748afdc2c12e, State: Initialized, Role: FOLLOWER
I20260809 12:03:31.923424 9888 consensus_queue.cc:260] T 37059914646d4ae09e036e9ceaad2b11 P f05528ac015e4f0cb0aa748afdc2c12e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.924139 9888 ts_tablet_manager.cc:1428] T 37059914646d4ae09e036e9ceaad2b11 P f05528ac015e4f0cb0aa748afdc2c12e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 12:03:31.924561 9888 tablet_bootstrap.cc:492] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e: Bootstrap starting.
I20260809 12:03:31.926709 9888 tablet_bootstrap.cc:654] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:31.927512 9425 tablet_service.cc:1467] Processing CreateTablet for tablet 557cb8ac83f9476db501304e6024b0f0 (DEFAULT_TABLE table=default.table_22580336a00e422aab032707ca16836e [id=6999f70d421f4417b855c361afdebc21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.927989 9425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 557cb8ac83f9476db501304e6024b0f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.927212 9937 raft_consensus.cc:482] T 85bb8662f3174951bbdb45c8fcbaa975 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:31.928275 9937 raft_consensus.cc:504] T 85bb8662f3174951bbdb45c8fcbaa975 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } }
I20260809 12:03:31.929067 9937 leader_election.cc:288] T 85bb8662f3174951bbdb45c8fcbaa975 P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793), cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479)
I20260809 12:03:31.929447 9899 raft_consensus.cc:482] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:31.929783 9899 raft_consensus.cc:504] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } }
I20260809 12:03:31.932129 9899 leader_election.cc:288] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723), cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479)
I20260809 12:03:31.932475 8253 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
/tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.15.126:45327
--webserver_interface=127.8.15.126
--webserver_port=37855
--builtin_ntp_servers=127.8.15.84:46271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--hive_metastore_uris=thrift://127.0.0.1:44923
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260809 12:03:31.936856 9884 ts_tablet_manager.cc:1428] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent starting tablet: real 0.017s user 0.003s sys 0.000s
I20260809 12:03:31.937361 9465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bb8662f3174951bbdb45c8fcbaa975" candidate_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde39fbb4ced4d049fef6754c3f3e796" is_pre_election: true
I20260809 12:03:31.937641 9465 raft_consensus.cc:2454] T 85bb8662f3174951bbdb45c8fcbaa975 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f05528ac015e4f0cb0aa748afdc2c12e in term 0.
I20260809 12:03:31.942518 9937 raft_consensus.cc:482] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:31.942751 9937 raft_consensus.cc:504] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.943543 9937 leader_election.cc:288] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:31.944484 8913 master_service.cc:946] ReplaceTablet: received request to replace tablet 75a3c4f588b148d998eec3f308e46cea from {username='slave'} at 127.0.0.1:59982
I20260809 12:03:31.952047 9465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a3c4f588b148d998eec3f308e46cea" candidate_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde39fbb4ced4d049fef6754c3f3e796" is_pre_election: true
I20260809 12:03:31.952338 9465 raft_consensus.cc:2454] T 75a3c4f588b148d998eec3f308e46cea P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f05528ac015e4f0cb0aa748afdc2c12e in term 0.
I20260809 12:03:31.952878 9125 leader_election.cc:302] T 85bb8662f3174951bbdb45c8fcbaa975 P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e; no voters:
I20260809 12:03:31.953260 9125 leader_election.cc:302] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e; no voters:
I20260809 12:03:31.953511 9681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bb8662f3174951bbdb45c8fcbaa975" candidate_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" is_pre_election: true
I20260809 12:03:31.953666 9939 raft_consensus.cc:2781] T 85bb8662f3174951bbdb45c8fcbaa975 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 12:03:31.953819 9681 raft_consensus.cc:2454] T 85bb8662f3174951bbdb45c8fcbaa975 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f05528ac015e4f0cb0aa748afdc2c12e in term 0.
I20260809 12:03:31.953889 9939 raft_consensus.cc:482] T 85bb8662f3174951bbdb45c8fcbaa975 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 12:03:31.954069 9939 raft_consensus.cc:3037] T 85bb8662f3174951bbdb45c8fcbaa975 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:31.954421 9681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a3c4f588b148d998eec3f308e46cea" candidate_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" is_pre_election: true
I20260809 12:03:31.954653 9681 raft_consensus.cc:2454] T 75a3c4f588b148d998eec3f308e46cea P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f05528ac015e4f0cb0aa748afdc2c12e in term 0.
I20260809 12:03:31.955533 8913 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: Sending DeleteTablet for 3 replicas of tablet 75a3c4f588b148d998eec3f308e46cea
I20260809 12:03:31.956400 8913 catalog_manager.cc:6565] ReplaceTablet: tablet 75a3c4f588b148d998eec3f308e46cea deleted and replaced by tablet 04848b966e9d454baddf302cbdb03535
I20260809 12:03:31.956717 8913 master_service.cc:946] ReplaceTablet: received request to replace tablet 75a3c4f588b148d998eec3f308e46cea from {username='slave'} at 127.0.0.1:59982
I20260809 12:03:31.957612 8913 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59982:
table { table_name: "default.Table_520e75ee39c74e6985dbd81c6f2e32f8" } modify_external_catalogs: true
I20260809 12:03:31.957512 9939 raft_consensus.cc:504] T 85bb8662f3174951bbdb45c8fcbaa975 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } }
I20260809 12:03:31.957940 8913 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59982:
table { table_name: "default.Table_520e75ee39c74e6985dbd81c6f2e32f8" } modify_external_catalogs: true
I20260809 12:03:31.958483 9937 raft_consensus.cc:2781] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 12:03:31.958621 9937 raft_consensus.cc:482] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 12:03:31.958782 9937 raft_consensus.cc:3037] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:31.959547 9939 leader_election.cc:288] T 85bb8662f3174951bbdb45c8fcbaa975 P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 election: Requested vote from peers e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793), cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479)
I20260809 12:03:31.961948 9425 tablet_service.cc:1514] Processing DeleteTablet for tablet 75a3c4f588b148d998eec3f308e46cea with delete_type TABLET_DATA_DELETED (replaced by tablet 04848b966e9d454baddf302cbdb03535) from {username='slave'} at 127.0.0.1:45542
I20260809 12:03:31.962289 9647 tablet_service.cc:1514] Processing DeleteTablet for tablet 75a3c4f588b148d998eec3f308e46cea with delete_type TABLET_DATA_DELETED (replaced by tablet 04848b966e9d454baddf302cbdb03535) from {username='slave'} at 127.0.0.1:36266
I20260809 12:03:31.962612 9915 tablet_replica.cc:330] T 75a3c4f588b148d998eec3f308e46cea P e0b5e4c0505c4122ae1349ee4beb5bd1: stopping tablet replica
I20260809 12:03:31.962666 9911 tablet_replica.cc:330] T 75a3c4f588b148d998eec3f308e46cea P cde39fbb4ced4d049fef6754c3f3e796: stopping tablet replica
I20260809 12:03:31.962857 9915 raft_consensus.cc:2229] T 75a3c4f588b148d998eec3f308e46cea P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260809 12:03:31.962875 9911 raft_consensus.cc:2229] T 75a3c4f588b148d998eec3f308e46cea P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260809 12:03:31.962764 9937 raft_consensus.cc:504] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:31.963079 9915 raft_consensus.cc:2258] T 75a3c4f588b148d998eec3f308e46cea P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:31.963073 9911 raft_consensus.cc:2258] T 75a3c4f588b148d998eec3f308e46cea P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:31.964033 9915 ts_tablet_manager.cc:1905] T 75a3c4f588b148d998eec3f308e46cea P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:31.964705 9911 ts_tablet_manager.cc:1905] T 75a3c4f588b148d998eec3f308e46cea P cde39fbb4ced4d049fef6754c3f3e796: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:31.971508 9915 ts_tablet_manager.cc:1918] T 75a3c4f588b148d998eec3f308e46cea P e0b5e4c0505c4122ae1349ee4beb5bd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260809 12:03:31.971561 9647 tablet_service.cc:1467] Processing CreateTablet for tablet 04848b966e9d454baddf302cbdb03535 (DEFAULT_TABLE table=default.table_da029d70439d48cc842a66906f93d903 [id=085a7a8b72ea4da2817e62d516fbcc38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.971716 9915 log.cc:1196] T 75a3c4f588b148d998eec3f308e46cea P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/wal/wals/75a3c4f588b148d998eec3f308e46cea
I20260809 12:03:31.972071 9647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04848b966e9d454baddf302cbdb03535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.972143 9915 ts_tablet_manager.cc:1939] T 75a3c4f588b148d998eec3f308e46cea P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting consensus metadata
I20260809 12:03:31.973222 8897 catalog_manager.cc:4841] TS e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793): tablet 75a3c4f588b148d998eec3f308e46cea (table default.table_da029d70439d48cc842a66906f93d903 [id=085a7a8b72ea4da2817e62d516fbcc38]) successfully deleted
I20260809 12:03:31.974187 9465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bb8662f3174951bbdb45c8fcbaa975" candidate_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde39fbb4ced4d049fef6754c3f3e796"
I20260809 12:03:31.974432 9465 raft_consensus.cc:3037] T 85bb8662f3174951bbdb45c8fcbaa975 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:31.975121 9200 tablet_service.cc:1467] Processing CreateTablet for tablet 04848b966e9d454baddf302cbdb03535 (DEFAULT_TABLE table=default.table_da029d70439d48cc842a66906f93d903 [id=085a7a8b72ea4da2817e62d516fbcc38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.975634 9200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04848b966e9d454baddf302cbdb03535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.977492 9911 ts_tablet_manager.cc:1918] T 75a3c4f588b148d998eec3f308e46cea P cde39fbb4ced4d049fef6754c3f3e796: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260809 12:03:31.977689 9463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a3c4f588b148d998eec3f308e46cea" candidate_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde39fbb4ced4d049fef6754c3f3e796"
I20260809 12:03:31.977696 9425 tablet_service.cc:1467] Processing CreateTablet for tablet 04848b966e9d454baddf302cbdb03535 (DEFAULT_TABLE table=default.table_da029d70439d48cc842a66906f93d903 [id=085a7a8b72ea4da2817e62d516fbcc38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:31.979444 9465 raft_consensus.cc:2454] T 85bb8662f3174951bbdb45c8fcbaa975 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f05528ac015e4f0cb0aa748afdc2c12e in term 1.
I20260809 12:03:31.979809 9425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04848b966e9d454baddf302cbdb03535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:31.983508 9198 tablet_service.cc:1514] Processing DeleteTablet for tablet 75a3c4f588b148d998eec3f308e46cea with delete_type TABLET_DATA_DELETED (replaced by tablet 04848b966e9d454baddf302cbdb03535) from {username='slave'} at 127.0.0.1:36636
I20260809 12:03:31.983811 9913 tablet_replica.cc:330] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e: stopping tablet replica
I20260809 12:03:31.984058 9913 raft_consensus.cc:2229] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 12:03:31.984279 9913 raft_consensus.cc:2258] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260809 12:03:31.984898 9125 leader_election.cc:341] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Illegal state: Tablet not RUNNING: STOPPED
I20260809 12:03:31.985049 9884 tablet_bootstrap.cc:492] T 04848b966e9d454baddf302cbdb03535 P e0b5e4c0505c4122ae1349ee4beb5bd1: Bootstrap starting.
I20260809 12:03:31.979846 9911 log.cc:1196] T 75a3c4f588b148d998eec3f308e46cea P cde39fbb4ced4d049fef6754c3f3e796: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/wal/wals/75a3c4f588b148d998eec3f308e46cea
I20260809 12:03:31.985229 9125 leader_election.cc:302] T 85bb8662f3174951bbdb45c8fcbaa975 P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e; no voters:
I20260809 12:03:31.985795 9911 ts_tablet_manager.cc:1939] T 75a3c4f588b148d998eec3f308e46cea P cde39fbb4ced4d049fef6754c3f3e796: Deleting consensus metadata
I20260809 12:03:31.987133 9884 tablet_bootstrap.cc:654] T 04848b966e9d454baddf302cbdb03535 P e0b5e4c0505c4122ae1349ee4beb5bd1: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:31.987877 8919 catalog_manager.cc:2148] created HMS catalog entry for table [id=a090addd1b9f4126b16d72d49ac02669]
I20260809 12:03:31.988456 9939 raft_consensus.cc:2781] T 85bb8662f3174951bbdb45c8fcbaa975 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 12:03:31.988667 9939 raft_consensus.cc:686] T 85bb8662f3174951bbdb45c8fcbaa975 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 LEADER]: Becoming Leader. State: Replica: f05528ac015e4f0cb0aa748afdc2c12e, State: Running, Role: LEADER
I20260809 12:03:31.988953 9939 consensus_queue.cc:237] T 85bb8662f3174951bbdb45c8fcbaa975 P f05528ac015e4f0cb0aa748afdc2c12e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } }
I20260809 12:03:31.989821 8896 catalog_manager.cc:4841] TS cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): tablet 75a3c4f588b148d998eec3f308e46cea (table default.table_da029d70439d48cc842a66906f93d903 [id=085a7a8b72ea4da2817e62d516fbcc38]) successfully deleted
I20260809 12:03:31.992076 9937 leader_election.cc:288] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 election: Requested vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:31.992977 9913 ts_tablet_manager.cc:1905] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:31.995807 8919 master_service.cc:946] ReplaceTablet: received request to replace tablet 75a3c4f588b148d998eec3f308e46cea from {username='slave'} at 127.0.0.1:59982
I20260809 12:03:31.996433 8919 master_service.cc:946] ReplaceTablet: received request to replace tablet 00bb1683a9eb4a4bbd2f46044989ddeb from {username='slave'} at 127.0.0.1:59982
I20260809 12:03:31.999763 9913 ts_tablet_manager.cc:1918] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260809 12:03:32.000052 9913 log.cc:1196] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/wal/wals/75a3c4f588b148d998eec3f308e46cea
I20260809 12:03:32.000550 9913 ts_tablet_manager.cc:1939] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e: Deleting consensus metadata
I20260809 12:03:32.004452 8895 catalog_manager.cc:4841] TS f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): tablet 75a3c4f588b148d998eec3f308e46cea (table default.table_da029d70439d48cc842a66906f93d903 [id=085a7a8b72ea4da2817e62d516fbcc38]) successfully deleted
I20260809 12:03:32.005298 9886 tablet_bootstrap.cc:492] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796: No bootstrap required, opened a new log
I20260809 12:03:32.005560 9886 ts_tablet_manager.cc:1397] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796: Time spent bootstrapping tablet: real 0.105s user 0.002s sys 0.006s
I20260809 12:03:32.006651 9886 raft_consensus.cc:348] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.006953 9886 raft_consensus.cc:374] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:32.007094 9886 raft_consensus.cc:729] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cde39fbb4ced4d049fef6754c3f3e796, State: Initialized, Role: FOLLOWER
I20260809 12:03:32.010828 8919 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: Sending DeleteTablet for 3 replicas of tablet 00bb1683a9eb4a4bbd2f46044989ddeb
I20260809 12:03:32.011226 9649 tablet_service.cc:1467] Processing CreateTablet for tablet 22df91f5859a43468782b4187bbafd45 (DEFAULT_TABLE table=default.table_22e16baa34234ab0a0b7841c1041884c [id=a090addd1b9f4126b16d72d49ac02669]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:32.011404 8919 catalog_manager.cc:6565] ReplaceTablet: tablet 00bb1683a9eb4a4bbd2f46044989ddeb deleted and replaced by tablet 6e51d6c18fd34cf29dd0ac00e81a4a8c
I20260809 12:03:32.011775 9649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22df91f5859a43468782b4187bbafd45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:32.011796 9427 tablet_service.cc:1514] Processing DeleteTablet for tablet 00bb1683a9eb4a4bbd2f46044989ddeb with delete_type TABLET_DATA_DELETED (replaced by tablet 6e51d6c18fd34cf29dd0ac00e81a4a8c) from {username='slave'} at 127.0.0.1:45542
I20260809 12:03:32.012517 9647 tablet_service.cc:1514] Processing DeleteTablet for tablet 00bb1683a9eb4a4bbd2f46044989ddeb with delete_type TABLET_DATA_DELETED (replaced by tablet 6e51d6c18fd34cf29dd0ac00e81a4a8c) from {username='slave'} at 127.0.0.1:36266
I20260809 12:03:32.013183 9911 tablet_replica.cc:330] T 00bb1683a9eb4a4bbd2f46044989ddeb P cde39fbb4ced4d049fef6754c3f3e796: stopping tablet replica
I20260809 12:03:32.013469 9911 raft_consensus.cc:2229] T 00bb1683a9eb4a4bbd2f46044989ddeb P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 12:03:32.013772 9911 raft_consensus.cc:2258] T 00bb1683a9eb4a4bbd2f46044989ddeb P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:32.016121 9911 ts_tablet_manager.cc:1905] T 00bb1683a9eb4a4bbd2f46044989ddeb P cde39fbb4ced4d049fef6754c3f3e796: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:32.019501 9915 tablet_replica.cc:330] T 00bb1683a9eb4a4bbd2f46044989ddeb P e0b5e4c0505c4122ae1349ee4beb5bd1: stopping tablet replica
I20260809 12:03:32.019745 9915 raft_consensus.cc:2229] T 00bb1683a9eb4a4bbd2f46044989ddeb P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 12:03:32.019992 9915 raft_consensus.cc:2258] T 00bb1683a9eb4a4bbd2f46044989ddeb P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:32.020172 9425 tablet_service.cc:1467] Processing CreateTablet for tablet 22df91f5859a43468782b4187bbafd45 (DEFAULT_TABLE table=default.table_22e16baa34234ab0a0b7841c1041884c [id=a090addd1b9f4126b16d72d49ac02669]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:32.020902 9425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22df91f5859a43468782b4187bbafd45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:32.023139 9915 ts_tablet_manager.cc:1905] T 00bb1683a9eb4a4bbd2f46044989ddeb P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:32.024458 9888 tablet_bootstrap.cc:492] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e: No bootstrap required, opened a new log
I20260809 12:03:32.024746 9198 tablet_service.cc:1514] Processing DeleteTablet for tablet 00bb1683a9eb4a4bbd2f46044989ddeb with delete_type TABLET_DATA_DELETED (replaced by tablet 6e51d6c18fd34cf29dd0ac00e81a4a8c) from {username='slave'} at 127.0.0.1:36636
I20260809 12:03:32.025013 9913 tablet_replica.cc:330] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e: stopping tablet replica
I20260809 12:03:32.025215 9913 raft_consensus.cc:2229] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e [term 1 LEADER]: Raft consensus shutting down.
I20260809 12:03:32.025746 9913 pending_rounds.cc:62] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e: Trying to abort 1 pending ops.
I20260809 12:03:32.025941 9913 pending_rounds.cc:68] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316590640607617024 op_type: NO_OP noop_request { }
I20260809 12:03:32.026247 9913 raft_consensus.cc:2866] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260809 12:03:32.026372 9913 raft_consensus.cc:2258] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:32.026880 9200 tablet_service.cc:1467] Processing CreateTablet for tablet 22df91f5859a43468782b4187bbafd45 (DEFAULT_TABLE table=default.table_22e16baa34234ab0a0b7841c1041884c [id=a090addd1b9f4126b16d72d49ac02669]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:32.027376 9200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22df91f5859a43468782b4187bbafd45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:32.027622 9913 ts_tablet_manager.cc:1905] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:32.028268 9229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c755c68ccba04ded80a352012364af5b" candidate_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" is_pre_election: true
I20260809 12:03:32.028676 9229 raft_consensus.cc:2454] T c755c68ccba04ded80a352012364af5b P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0b5e4c0505c4122ae1349ee4beb5bd1 in term 0.
I20260809 12:03:32.029291 9571 leader_election.cc:302] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1, f05528ac015e4f0cb0aa748afdc2c12e; no voters:
I20260809 12:03:32.029793 9899 raft_consensus.cc:2781] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 12:03:32.029925 9899 raft_consensus.cc:482] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 12:03:32.030023 9899 raft_consensus.cc:3037] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:32.030361 9911 ts_tablet_manager.cc:1918] T 00bb1683a9eb4a4bbd2f46044989ddeb P cde39fbb4ced4d049fef6754c3f3e796: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260809 12:03:32.031406 9911 log.cc:1196] T 00bb1683a9eb4a4bbd2f46044989ddeb P cde39fbb4ced4d049fef6754c3f3e796: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/wal/wals/00bb1683a9eb4a4bbd2f46044989ddeb
I20260809 12:03:32.031859 9911 ts_tablet_manager.cc:1939] T 00bb1683a9eb4a4bbd2f46044989ddeb P cde39fbb4ced4d049fef6754c3f3e796: Deleting consensus metadata
I20260809 12:03:32.032789 9899 raft_consensus.cc:504] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } }
I20260809 12:03:32.033167 8896 catalog_manager.cc:4841] TS cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): tablet 00bb1683a9eb4a4bbd2f46044989ddeb (table default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf]) successfully deleted
I20260809 12:03:32.033502 9899 leader_election.cc:288] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 1 election: Requested vote from peers f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723), cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479)
I20260809 12:03:32.034047 9888 ts_tablet_manager.cc:1397] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e: Time spent bootstrapping tablet: real 0.110s user 0.004s sys 0.011s
I20260809 12:03:32.034926 9888 raft_consensus.cc:348] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } }
I20260809 12:03:32.035171 9888 raft_consensus.cc:374] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:32.035316 9888 raft_consensus.cc:729] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f05528ac015e4f0cb0aa748afdc2c12e, State: Initialized, Role: FOLLOWER
I20260809 12:03:32.035569 9888 consensus_queue.cc:260] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } }
I20260809 12:03:32.036168 9888 ts_tablet_manager.cc:1428] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 12:03:32.036500 9888 tablet_bootstrap.cc:492] T 12eb84afa6ce467989205478da21f1bf P f05528ac015e4f0cb0aa748afdc2c12e: Bootstrap starting.
I20260809 12:03:32.037387 9913 ts_tablet_manager.cc:1918] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:32.037402 9681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85bb8662f3174951bbdb45c8fcbaa975" candidate_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1"
I20260809 12:03:32.037636 9681 raft_consensus.cc:3037] T 85bb8662f3174951bbdb45c8fcbaa975 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:32.037698 9913 log.cc:1196] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/wal/wals/00bb1683a9eb4a4bbd2f46044989ddeb
I20260809 12:03:32.038246 9888 tablet_bootstrap.cc:654] T 12eb84afa6ce467989205478da21f1bf P f05528ac015e4f0cb0aa748afdc2c12e: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:32.038375 9913 ts_tablet_manager.cc:1939] T 00bb1683a9eb4a4bbd2f46044989ddeb P f05528ac015e4f0cb0aa748afdc2c12e: Deleting consensus metadata
I20260809 12:03:32.039608 9229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c755c68ccba04ded80a352012364af5b" candidate_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f05528ac015e4f0cb0aa748afdc2c12e"
I20260809 12:03:32.039791 9229 raft_consensus.cc:3037] T c755c68ccba04ded80a352012364af5b P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:32.040699 9681 raft_consensus.cc:2454] T 85bb8662f3174951bbdb45c8fcbaa975 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f05528ac015e4f0cb0aa748afdc2c12e in term 1.
I20260809 12:03:32.042546 9229 raft_consensus.cc:2454] T c755c68ccba04ded80a352012364af5b P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0b5e4c0505c4122ae1349ee4beb5bd1 in term 1.
W20260809 12:03:32.043088 9127 leader_election.cc:341] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793): Not found: Tablet not found: 75a3c4f588b148d998eec3f308e46cea
I20260809 12:03:32.043299 8895 catalog_manager.cc:4841] TS f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): tablet 00bb1683a9eb4a4bbd2f46044989ddeb (table default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf]) successfully deleted
I20260809 12:03:32.043251 9127 leader_election.cc:302] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f05528ac015e4f0cb0aa748afdc2c12e; no voters: cde39fbb4ced4d049fef6754c3f3e796, e0b5e4c0505c4122ae1349ee4beb5bd1
W20260809 12:03:32.043571 9127 raft_consensus.cc:2670] T 75a3c4f588b148d998eec3f308e46cea P f05528ac015e4f0cb0aa748afdc2c12e: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260809 12:03:32.044035 9915 ts_tablet_manager.cc:1918] T 00bb1683a9eb4a4bbd2f46044989ddeb P e0b5e4c0505c4122ae1349ee4beb5bd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260809 12:03:32.044212 9915 log.cc:1196] T 00bb1683a9eb4a4bbd2f46044989ddeb P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/wal/wals/00bb1683a9eb4a4bbd2f46044989ddeb
I20260809 12:03:32.044641 9915 ts_tablet_manager.cc:1939] T 00bb1683a9eb4a4bbd2f46044989ddeb P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting consensus metadata
I20260809 12:03:32.044647 9465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c755c68ccba04ded80a352012364af5b" candidate_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde39fbb4ced4d049fef6754c3f3e796" is_pre_election: true
I20260809 12:03:32.044939 9465 raft_consensus.cc:2454] T c755c68ccba04ded80a352012364af5b P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0b5e4c0505c4122ae1349ee4beb5bd1 in term 0.
I20260809 12:03:32.045280 9463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c755c68ccba04ded80a352012364af5b" candidate_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde39fbb4ced4d049fef6754c3f3e796"
I20260809 12:03:32.045501 9463 raft_consensus.cc:3037] T c755c68ccba04ded80a352012364af5b P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:32.045708 8897 catalog_manager.cc:4841] TS e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793): tablet 00bb1683a9eb4a4bbd2f46044989ddeb (table default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf]) successfully deleted
I20260809 12:03:32.047791 9571 leader_election.cc:302] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1, f05528ac015e4f0cb0aa748afdc2c12e; no voters:
I20260809 12:03:32.048398 9899 raft_consensus.cc:2781] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader election won for term 1
F20260809 12:03:32.048643 9044 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 1): 1 CREATE_TABLE default.table_badbfc92917e45a5aa60e47244ae5ff5
*** Check failure stack trace: ***
I20260809 12:03:32.049460 9463 raft_consensus.cc:2454] T c755c68ccba04ded80a352012364af5b P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0b5e4c0505c4122ae1349ee4beb5bd1 in term 1.
I20260809 12:03:32.050693 9899 raft_consensus.cc:686] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 LEADER]: Becoming Leader. State: Replica: e0b5e4c0505c4122ae1349ee4beb5bd1, State: Running, Role: LEADER
I20260809 12:03:32.051169 9899 consensus_queue.cc:237] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } }
@ 0x7f6de5c229ad google::LogMessage::Fail() at ??:0
I20260809 12:03:32.052361 8919 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59982:
name: "default.Table_19152f3d2b804962b678450f144cbb7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
@ 0x7f6de5c2588a google::LogMessage::SendToLog() at ??:0
I20260809 12:03:32.053977 9886 consensus_queue.cc:260] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
@ 0x7f6de5c224de google::LogMessage::Flush() at ??:0
@ 0x7f6de5c226d1 google::LogMessage::~LogMessage() at ??:0
I20260809 12:03:32.060025 9886 ts_tablet_manager.cc:1428] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796: Time spent starting tablet: real 0.054s user 0.001s sys 0.002s
I20260809 12:03:32.062189 9198 tablet_service.cc:1467] Processing CreateTablet for tablet 6e51d6c18fd34cf29dd0ac00e81a4a8c (DEFAULT_TABLE table=default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:32.062325 9649 tablet_service.cc:1467] Processing CreateTablet for tablet 6e51d6c18fd34cf29dd0ac00e81a4a8c (DEFAULT_TABLE table=default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:32.062678 9198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e51d6c18fd34cf29dd0ac00e81a4a8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:32.062742 9649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e51d6c18fd34cf29dd0ac00e81a4a8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:32.064435 9884 tablet_bootstrap.cc:492] T 04848b966e9d454baddf302cbdb03535 P e0b5e4c0505c4122ae1349ee4beb5bd1: No bootstrap required, opened a new log
I20260809 12:03:32.064687 9884 ts_tablet_manager.cc:1397] T 04848b966e9d454baddf302cbdb03535 P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent bootstrapping tablet: real 0.080s user 0.002s sys 0.011s
I20260809 12:03:32.065879 9884 raft_consensus.cc:348] T 04848b966e9d454baddf302cbdb03535 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.066183 9884 raft_consensus.cc:374] T 04848b966e9d454baddf302cbdb03535 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:32.066273 9884 raft_consensus.cc:729] T 04848b966e9d454baddf302cbdb03535 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0b5e4c0505c4122ae1349ee4beb5bd1, State: Initialized, Role: FOLLOWER
I20260809 12:03:32.066630 9884 consensus_queue.cc:260] T 04848b966e9d454baddf302cbdb03535 P e0b5e4c0505c4122ae1349ee4beb5bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.067494 9884 ts_tablet_manager.cc:1428] T 04848b966e9d454baddf302cbdb03535 P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260809 12:03:32.070111 9884 tablet_bootstrap.cc:492] T 557cb8ac83f9476db501304e6024b0f0 P e0b5e4c0505c4122ae1349ee4beb5bd1: Bootstrap starting.
I20260809 12:03:32.070256 9425 tablet_service.cc:1467] Processing CreateTablet for tablet 6e51d6c18fd34cf29dd0ac00e81a4a8c (DEFAULT_TABLE table=default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:32.070736 9425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e51d6c18fd34cf29dd0ac00e81a4a8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:32.071666 9886 tablet_bootstrap.cc:492] T 557cb8ac83f9476db501304e6024b0f0 P cde39fbb4ced4d049fef6754c3f3e796: Bootstrap starting.
@ 0x7f6dfb7c0ba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260809 12:03:32.073381 9884 tablet_bootstrap.cc:654] T 557cb8ac83f9476db501304e6024b0f0 P e0b5e4c0505c4122ae1349ee4beb5bd1: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:32.073774 9904 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:32.074023 9904 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.076330 9904 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723), e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
@ 0x7f6dfb7bf901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7f6dfb7c666c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260809 12:03:32.085798 9884 tablet_bootstrap.cc:492] T 557cb8ac83f9476db501304e6024b0f0 P e0b5e4c0505c4122ae1349ee4beb5bd1: No bootstrap required, opened a new log
I20260809 12:03:32.085988 9884 ts_tablet_manager.cc:1397] T 557cb8ac83f9476db501304e6024b0f0 P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.007s
I20260809 12:03:32.087152 9884 raft_consensus.cc:348] T 557cb8ac83f9476db501304e6024b0f0 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } }
I20260809 12:03:32.087594 9884 raft_consensus.cc:374] T 557cb8ac83f9476db501304e6024b0f0 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:32.087838 9884 raft_consensus.cc:729] T 557cb8ac83f9476db501304e6024b0f0 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0b5e4c0505c4122ae1349ee4beb5bd1, State: Initialized, Role: FOLLOWER
I20260809 12:03:32.088315 9884 consensus_queue.cc:260] T 557cb8ac83f9476db501304e6024b0f0 P e0b5e4c0505c4122ae1349ee4beb5bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } }
@ 0x7f6dfb7c64e9 std::_Function_handler<>::_M_invoke() at ??:0
I20260809 12:03:32.093004 9884 ts_tablet_manager.cc:1428] T 557cb8ac83f9476db501304e6024b0f0 P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260809 12:03:32.094388 9681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37059914646d4ae09e036e9ceaad2b11" candidate_uuid: "cde39fbb4ced4d049fef6754c3f3e796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" is_pre_election: true
I20260809 12:03:32.094687 9681 raft_consensus.cc:2454] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cde39fbb4ced4d049fef6754c3f3e796 in term 0.
@ 0x9edb7d std::function<>::operator()() at ??:?
I20260809 12:03:32.095544 9351 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cde39fbb4ced4d049fef6754c3f3e796, e0b5e4c0505c4122ae1349ee4beb5bd1; no voters:
I20260809 12:03:32.095897 9884 tablet_bootstrap.cc:492] T 22df91f5859a43468782b4187bbafd45 P e0b5e4c0505c4122ae1349ee4beb5bd1: Bootstrap starting.
I20260809 12:03:32.096408 9904 raft_consensus.cc:2781] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 12:03:32.096772 9904 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 12:03:32.096976 9904 raft_consensus.cc:3037] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:32.098621 9884 tablet_bootstrap.cc:654] T 22df91f5859a43468782b4187bbafd45 P e0b5e4c0505c4122ae1349ee4beb5bd1: Neither blocks nor log segments found. Creating new log.
@ 0x7f6de884ceaf kudu::Thread::SuperviseThread() at ??:0
I20260809 12:03:32.100824 9904 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
@ 0x7f6debb266db start_thread at ??:0
I20260809 12:03:32.102229 9681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37059914646d4ae09e036e9ceaad2b11" candidate_uuid: "cde39fbb4ced4d049fef6754c3f3e796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1"
I20260809 12:03:32.102519 9681 raft_consensus.cc:3037] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Advancing to term 1
@ 0x7f6de4abc61f clone at ??:0
I20260809 12:03:32.105988 9884 tablet_bootstrap.cc:492] T 22df91f5859a43468782b4187bbafd45 P e0b5e4c0505c4122ae1349ee4beb5bd1: No bootstrap required, opened a new log
I20260809 12:03:32.106142 9884 ts_tablet_manager.cc:1397] T 22df91f5859a43468782b4187bbafd45 P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20260809 12:03:32.106094 9681 raft_consensus.cc:2454] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cde39fbb4ced4d049fef6754c3f3e796 in term 1.
I20260809 12:03:32.106712 9351 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cde39fbb4ced4d049fef6754c3f3e796, e0b5e4c0505c4122ae1349ee4beb5bd1; no voters:
I20260809 12:03:32.107026 9884 raft_consensus.cc:348] T 22df91f5859a43468782b4187bbafd45 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.107297 9884 raft_consensus.cc:374] T 22df91f5859a43468782b4187bbafd45 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:32.107378 9884 raft_consensus.cc:729] T 22df91f5859a43468782b4187bbafd45 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0b5e4c0505c4122ae1349ee4beb5bd1, State: Initialized, Role: FOLLOWER
I20260809 12:03:32.107790 9884 consensus_queue.cc:260] T 22df91f5859a43468782b4187bbafd45 P e0b5e4c0505c4122ae1349ee4beb5bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.116412 9884 ts_tablet_manager.cc:1428] T 22df91f5859a43468782b4187bbafd45 P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent starting tablet: real 0.010s user 0.000s sys 0.003s
I20260809 12:03:32.118649 9904 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796 [CANDIDATE]: Term 1 election: Requested vote from peers f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723), e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:32.118887 9904 raft_consensus.cc:2781] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 12:03:32.119045 9904 raft_consensus.cc:686] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 LEADER]: Becoming Leader. State: Replica: cde39fbb4ced4d049fef6754c3f3e796, State: Running, Role: LEADER
I20260809 12:03:32.119127 9884 tablet_bootstrap.cc:492] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P e0b5e4c0505c4122ae1349ee4beb5bd1: Bootstrap starting.
I20260809 12:03:32.119643 9904 consensus_queue.cc:237] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.121914 9884 tablet_bootstrap.cc:654] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P e0b5e4c0505c4122ae1349ee4beb5bd1: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:32.126391 9229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37059914646d4ae09e036e9ceaad2b11" candidate_uuid: "cde39fbb4ced4d049fef6754c3f3e796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" is_pre_election: true
I20260809 12:03:32.126813 9229 raft_consensus.cc:2454] T 37059914646d4ae09e036e9ceaad2b11 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cde39fbb4ced4d049fef6754c3f3e796 in term 0.
I20260809 12:03:32.126752 9226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37059914646d4ae09e036e9ceaad2b11" candidate_uuid: "cde39fbb4ced4d049fef6754c3f3e796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f05528ac015e4f0cb0aa748afdc2c12e"
I20260809 12:03:32.127125 9226 raft_consensus.cc:3037] T 37059914646d4ae09e036e9ceaad2b11 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:32.129323 9226 raft_consensus.cc:2454] T 37059914646d4ae09e036e9ceaad2b11 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cde39fbb4ced4d049fef6754c3f3e796 in term 1.
I20260809 12:03:32.131390 9886 tablet_bootstrap.cc:654] T 557cb8ac83f9476db501304e6024b0f0 P cde39fbb4ced4d049fef6754c3f3e796: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:32.136669 9884 tablet_bootstrap.cc:492] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P e0b5e4c0505c4122ae1349ee4beb5bd1: No bootstrap required, opened a new log
I20260809 12:03:32.136858 9884 ts_tablet_manager.cc:1397] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.000s
I20260809 12:03:32.137998 9884 raft_consensus.cc:348] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.138525 9884 raft_consensus.cc:374] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:32.138669 9884 raft_consensus.cc:729] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0b5e4c0505c4122ae1349ee4beb5bd1, State: Initialized, Role: FOLLOWER
I20260809 12:03:32.138990 9884 consensus_queue.cc:260] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P e0b5e4c0505c4122ae1349ee4beb5bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.139856 9884 ts_tablet_manager.cc:1428] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260809 12:03:32.145285 9888 tablet_bootstrap.cc:492] T 12eb84afa6ce467989205478da21f1bf P f05528ac015e4f0cb0aa748afdc2c12e: No bootstrap required, opened a new log
I20260809 12:03:32.145506 9888 ts_tablet_manager.cc:1397] T 12eb84afa6ce467989205478da21f1bf P f05528ac015e4f0cb0aa748afdc2c12e: Time spent bootstrapping tablet: real 0.109s user 0.000s sys 0.003s
I20260809 12:03:32.146464 9888 raft_consensus.cc:348] T 12eb84afa6ce467989205478da21f1bf P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.146736 9888 raft_consensus.cc:374] T 12eb84afa6ce467989205478da21f1bf P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:32.146844 9888 raft_consensus.cc:729] T 12eb84afa6ce467989205478da21f1bf P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f05528ac015e4f0cb0aa748afdc2c12e, State: Initialized, Role: FOLLOWER
I20260809 12:03:32.147235 9888 consensus_queue.cc:260] T 12eb84afa6ce467989205478da21f1bf P f05528ac015e4f0cb0aa748afdc2c12e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.149143 9888 ts_tablet_manager.cc:1428] T 12eb84afa6ce467989205478da21f1bf P f05528ac015e4f0cb0aa748afdc2c12e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 12:03:32.150972 9888 tablet_bootstrap.cc:492] T 04848b966e9d454baddf302cbdb03535 P f05528ac015e4f0cb0aa748afdc2c12e: Bootstrap starting.
I20260809 12:03:32.153697 9886 tablet_bootstrap.cc:492] T 557cb8ac83f9476db501304e6024b0f0 P cde39fbb4ced4d049fef6754c3f3e796: No bootstrap required, opened a new log
I20260809 12:03:32.153872 9886 ts_tablet_manager.cc:1397] T 557cb8ac83f9476db501304e6024b0f0 P cde39fbb4ced4d049fef6754c3f3e796: Time spent bootstrapping tablet: real 0.082s user 0.009s sys 0.013s
I20260809 12:03:32.154106 9888 tablet_bootstrap.cc:654] T 04848b966e9d454baddf302cbdb03535 P f05528ac015e4f0cb0aa748afdc2c12e: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:32.154659 9886 raft_consensus.cc:348] T 557cb8ac83f9476db501304e6024b0f0 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } }
I20260809 12:03:32.154894 9886 raft_consensus.cc:374] T 557cb8ac83f9476db501304e6024b0f0 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:32.154995 9886 raft_consensus.cc:729] T 557cb8ac83f9476db501304e6024b0f0 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cde39fbb4ced4d049fef6754c3f3e796, State: Initialized, Role: FOLLOWER
I20260809 12:03:32.155436 9886 consensus_queue.cc:260] T 557cb8ac83f9476db501304e6024b0f0 P cde39fbb4ced4d049fef6754c3f3e796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } }
I20260809 12:03:32.156102 9886 ts_tablet_manager.cc:1428] T 557cb8ac83f9476db501304e6024b0f0 P cde39fbb4ced4d049fef6754c3f3e796: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 12:03:32.159575 9886 tablet_bootstrap.cc:492] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796: Bootstrap starting.
I20260809 12:03:32.161368 9886 tablet_bootstrap.cc:654] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:32.172634 9886 tablet_bootstrap.cc:492] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796: No bootstrap required, opened a new log
I20260809 12:03:32.172775 9886 ts_tablet_manager.cc:1397] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20260809 12:03:32.173578 9886 raft_consensus.cc:348] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.173806 9886 raft_consensus.cc:374] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:32.173889 9886 raft_consensus.cc:729] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cde39fbb4ced4d049fef6754c3f3e796, State: Initialized, Role: FOLLOWER
I20260809 12:03:32.174140 9886 consensus_queue.cc:260] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.175581 9886 ts_tablet_manager.cc:1428] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260809 12:03:32.175971 9886 tablet_bootstrap.cc:492] T 22df91f5859a43468782b4187bbafd45 P cde39fbb4ced4d049fef6754c3f3e796: Bootstrap starting.
I20260809 12:03:32.177681 9886 tablet_bootstrap.cc:654] T 22df91f5859a43468782b4187bbafd45 P cde39fbb4ced4d049fef6754c3f3e796: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:32.179816 9888 tablet_bootstrap.cc:492] T 04848b966e9d454baddf302cbdb03535 P f05528ac015e4f0cb0aa748afdc2c12e: No bootstrap required, opened a new log
I20260809 12:03:32.180029 9888 ts_tablet_manager.cc:1397] T 04848b966e9d454baddf302cbdb03535 P f05528ac015e4f0cb0aa748afdc2c12e: Time spent bootstrapping tablet: real 0.031s user 0.008s sys 0.020s
I20260809 12:03:32.180727 9886 tablet_bootstrap.cc:492] T 22df91f5859a43468782b4187bbafd45 P cde39fbb4ced4d049fef6754c3f3e796: No bootstrap required, opened a new log
I20260809 12:03:32.180866 9886 ts_tablet_manager.cc:1397] T 22df91f5859a43468782b4187bbafd45 P cde39fbb4ced4d049fef6754c3f3e796: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 12:03:32.180897 9888 raft_consensus.cc:348] T 04848b966e9d454baddf302cbdb03535 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.181131 9888 raft_consensus.cc:374] T 04848b966e9d454baddf302cbdb03535 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:32.181278 9888 raft_consensus.cc:729] T 04848b966e9d454baddf302cbdb03535 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f05528ac015e4f0cb0aa748afdc2c12e, State: Initialized, Role: FOLLOWER
I20260809 12:03:32.181543 9886 raft_consensus.cc:348] T 22df91f5859a43468782b4187bbafd45 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.181572 9888 consensus_queue.cc:260] T 04848b966e9d454baddf302cbdb03535 P f05528ac015e4f0cb0aa748afdc2c12e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.181772 9886 raft_consensus.cc:374] T 22df91f5859a43468782b4187bbafd45 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:32.181833 9886 raft_consensus.cc:729] T 22df91f5859a43468782b4187bbafd45 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cde39fbb4ced4d049fef6754c3f3e796, State: Initialized, Role: FOLLOWER
I20260809 12:03:32.182067 9886 consensus_queue.cc:260] T 22df91f5859a43468782b4187bbafd45 P cde39fbb4ced4d049fef6754c3f3e796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.182724 9886 ts_tablet_manager.cc:1428] T 22df91f5859a43468782b4187bbafd45 P cde39fbb4ced4d049fef6754c3f3e796: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260809 12:03:32.183005 9886 tablet_bootstrap.cc:492] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P cde39fbb4ced4d049fef6754c3f3e796: Bootstrap starting.
I20260809 12:03:32.183213 9888 ts_tablet_manager.cc:1428] T 04848b966e9d454baddf302cbdb03535 P f05528ac015e4f0cb0aa748afdc2c12e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260809 12:03:32.183537 9888 tablet_bootstrap.cc:492] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P f05528ac015e4f0cb0aa748afdc2c12e: Bootstrap starting.
I20260809 12:03:32.184608 9886 tablet_bootstrap.cc:654] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P cde39fbb4ced4d049fef6754c3f3e796: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:32.187988 9888 tablet_bootstrap.cc:654] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P f05528ac015e4f0cb0aa748afdc2c12e: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:32.197990 9886 tablet_bootstrap.cc:492] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P cde39fbb4ced4d049fef6754c3f3e796: No bootstrap required, opened a new log
I20260809 12:03:32.198143 9886 ts_tablet_manager.cc:1397] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P cde39fbb4ced4d049fef6754c3f3e796: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.000s
I20260809 12:03:32.199194 9886 raft_consensus.cc:348] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.203317 9886 raft_consensus.cc:374] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:32.203485 9886 raft_consensus.cc:729] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cde39fbb4ced4d049fef6754c3f3e796, State: Initialized, Role: FOLLOWER
I20260809 12:03:32.203742 9886 consensus_queue.cc:260] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P cde39fbb4ced4d049fef6754c3f3e796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.204487 9886 ts_tablet_manager.cc:1428] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P cde39fbb4ced4d049fef6754c3f3e796: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260809 12:03:32.206974 9888 tablet_bootstrap.cc:492] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P f05528ac015e4f0cb0aa748afdc2c12e: No bootstrap required, opened a new log
I20260809 12:03:32.207142 9888 ts_tablet_manager.cc:1397] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P f05528ac015e4f0cb0aa748afdc2c12e: Time spent bootstrapping tablet: real 0.024s user 0.018s sys 0.001s
I20260809 12:03:32.207891 9888 raft_consensus.cc:348] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.208158 9888 raft_consensus.cc:374] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:32.208230 9888 raft_consensus.cc:729] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f05528ac015e4f0cb0aa748afdc2c12e, State: Initialized, Role: FOLLOWER
I20260809 12:03:32.208518 9888 consensus_queue.cc:260] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P f05528ac015e4f0cb0aa748afdc2c12e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.210183 9888 ts_tablet_manager.cc:1428] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P f05528ac015e4f0cb0aa748afdc2c12e: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260809 12:03:32.210494 9888 tablet_bootstrap.cc:492] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e: Bootstrap starting.
I20260809 12:03:32.212085 9888 tablet_bootstrap.cc:654] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:32.215425 9888 tablet_bootstrap.cc:492] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e: No bootstrap required, opened a new log
I20260809 12:03:32.215564 9888 ts_tablet_manager.cc:1397] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260809 12:03:32.216269 9888 raft_consensus.cc:348] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.216528 9888 raft_consensus.cc:374] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:32.216610 9888 raft_consensus.cc:729] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f05528ac015e4f0cb0aa748afdc2c12e, State: Initialized, Role: FOLLOWER
I20260809 12:03:32.216833 9888 consensus_queue.cc:260] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.218359 9888 ts_tablet_manager.cc:1428] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260809 12:03:32.258679 9939 raft_consensus.cc:482] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:32.258891 9939 raft_consensus.cc:504] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } }
I20260809 12:03:32.259727 9939 leader_election.cc:288] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793), cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479)
I20260809 12:03:32.261070 9681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "557cb8ac83f9476db501304e6024b0f0" candidate_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" is_pre_election: true
I20260809 12:03:32.261330 9681 raft_consensus.cc:2454] T 557cb8ac83f9476db501304e6024b0f0 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f05528ac015e4f0cb0aa748afdc2c12e in term 0.
I20260809 12:03:32.261765 9463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "557cb8ac83f9476db501304e6024b0f0" candidate_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde39fbb4ced4d049fef6754c3f3e796" is_pre_election: true
I20260809 12:03:32.262034 9463 raft_consensus.cc:2454] T 557cb8ac83f9476db501304e6024b0f0 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f05528ac015e4f0cb0aa748afdc2c12e in term 0.
I20260809 12:03:32.262440 9127 leader_election.cc:302] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1, f05528ac015e4f0cb0aa748afdc2c12e; no voters:
I20260809 12:03:32.262878 9939 raft_consensus.cc:2781] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 12:03:32.262996 9939 raft_consensus.cc:482] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 12:03:32.263079 9939 raft_consensus.cc:3037] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:32.266013 9939 raft_consensus.cc:504] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } }
I20260809 12:03:32.267112 9681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "557cb8ac83f9476db501304e6024b0f0" candidate_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1"
I20260809 12:03:32.267350 9681 raft_consensus.cc:3037] T 557cb8ac83f9476db501304e6024b0f0 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:32.268945 9939 leader_election.cc:288] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 election: Requested vote from peers e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793), cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479)
I20260809 12:03:32.269409 9463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "557cb8ac83f9476db501304e6024b0f0" candidate_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde39fbb4ced4d049fef6754c3f3e796"
I20260809 12:03:32.269644 9463 raft_consensus.cc:3037] T 557cb8ac83f9476db501304e6024b0f0 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:32.270242 9681 raft_consensus.cc:2454] T 557cb8ac83f9476db501304e6024b0f0 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f05528ac015e4f0cb0aa748afdc2c12e in term 1.
I20260809 12:03:32.270702 9127 leader_election.cc:302] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1, f05528ac015e4f0cb0aa748afdc2c12e; no voters:
I20260809 12:03:32.271070 9939 raft_consensus.cc:2781] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 12:03:32.271606 9939 raft_consensus.cc:686] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 LEADER]: Becoming Leader. State: Replica: f05528ac015e4f0cb0aa748afdc2c12e, State: Running, Role: LEADER
I20260809 12:03:32.271899 9939 consensus_queue.cc:237] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } }
I20260809 12:03:32.272473 9463 raft_consensus.cc:2454] T 557cb8ac83f9476db501304e6024b0f0 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f05528ac015e4f0cb0aa748afdc2c12e in term 1.
I20260809 12:03:32.305544 9939 raft_consensus.cc:482] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:32.305797 9939 raft_consensus.cc:504] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.307216 9463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22df91f5859a43468782b4187bbafd45" candidate_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde39fbb4ced4d049fef6754c3f3e796" is_pre_election: true
I20260809 12:03:32.307230 9681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22df91f5859a43468782b4187bbafd45" candidate_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" is_pre_election: true
I20260809 12:03:32.307571 9463 raft_consensus.cc:2454] T 22df91f5859a43468782b4187bbafd45 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f05528ac015e4f0cb0aa748afdc2c12e in term 0.
I20260809 12:03:32.307572 9681 raft_consensus.cc:2454] T 22df91f5859a43468782b4187bbafd45 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f05528ac015e4f0cb0aa748afdc2c12e in term 0.
I20260809 12:03:32.308054 9127 leader_election.cc:302] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1, f05528ac015e4f0cb0aa748afdc2c12e; no voters:
I20260809 12:03:32.308377 9937 raft_consensus.cc:2781] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 12:03:32.308532 9937 raft_consensus.cc:482] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 12:03:32.308532 9939 leader_election.cc:288] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:32.308665 9937 raft_consensus.cc:3037] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:32.311590 9937 raft_consensus.cc:504] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.312201 9937 leader_election.cc:288] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 election: Requested vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:32.312879 9463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22df91f5859a43468782b4187bbafd45" candidate_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde39fbb4ced4d049fef6754c3f3e796"
I20260809 12:03:32.312877 9681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22df91f5859a43468782b4187bbafd45" candidate_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1"
I20260809 12:03:32.313112 9681 raft_consensus.cc:3037] T 22df91f5859a43468782b4187bbafd45 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:32.313113 9463 raft_consensus.cc:3037] T 22df91f5859a43468782b4187bbafd45 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:32.316010 9681 raft_consensus.cc:2454] T 22df91f5859a43468782b4187bbafd45 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f05528ac015e4f0cb0aa748afdc2c12e in term 1.
I20260809 12:03:32.316048 9463 raft_consensus.cc:2454] T 22df91f5859a43468782b4187bbafd45 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f05528ac015e4f0cb0aa748afdc2c12e in term 1.
I20260809 12:03:32.316535 9127 leader_election.cc:302] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1, f05528ac015e4f0cb0aa748afdc2c12e; no voters:
I20260809 12:03:32.317013 9937 raft_consensus.cc:2781] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 12:03:32.317157 9937 raft_consensus.cc:686] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 LEADER]: Becoming Leader. State: Replica: f05528ac015e4f0cb0aa748afdc2c12e, State: Running, Role: LEADER
I20260809 12:03:32.317416 9937 consensus_queue.cc:237] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.320493 9939 raft_consensus.cc:482] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:32.320680 9939 raft_consensus.cc:504] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.321616 9939 leader_election.cc:288] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:32.322057 9463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e51d6c18fd34cf29dd0ac00e81a4a8c" candidate_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde39fbb4ced4d049fef6754c3f3e796" is_pre_election: true
I20260809 12:03:32.322281 9681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e51d6c18fd34cf29dd0ac00e81a4a8c" candidate_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" is_pre_election: true
I20260809 12:03:32.322347 9463 raft_consensus.cc:2454] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f05528ac015e4f0cb0aa748afdc2c12e in term 0.
I20260809 12:03:32.322739 9681 raft_consensus.cc:2454] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f05528ac015e4f0cb0aa748afdc2c12e in term 0.
I20260809 12:03:32.322737 9125 leader_election.cc:302] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e; no voters:
I20260809 12:03:32.323438 9939 raft_consensus.cc:2781] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 12:03:32.323553 9939 raft_consensus.cc:482] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 12:03:32.323643 9939 raft_consensus.cc:3037] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:32.326666 9939 raft_consensus.cc:504] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.327822 9463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e51d6c18fd34cf29dd0ac00e81a4a8c" candidate_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde39fbb4ced4d049fef6754c3f3e796"
I20260809 12:03:32.328073 9463 raft_consensus.cc:3037] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:32.330947 9463 raft_consensus.cc:2454] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f05528ac015e4f0cb0aa748afdc2c12e in term 1.
I20260809 12:03:32.331512 9125 leader_election.cc:302] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e; no voters:
I20260809 12:03:32.331800 9896 raft_consensus.cc:2781] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 12:03:32.331952 9896 raft_consensus.cc:686] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P f05528ac015e4f0cb0aa748afdc2c12e [term 1 LEADER]: Becoming Leader. State: Replica: f05528ac015e4f0cb0aa748afdc2c12e, State: Running, Role: LEADER
I20260809 12:03:32.332140 9939 leader_election.cc:288] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P f05528ac015e4f0cb0aa748afdc2c12e [CANDIDATE]: Term 1 election: Requested vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:32.332218 9896 consensus_queue.cc:237] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P f05528ac015e4f0cb0aa748afdc2c12e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.333556 9681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e51d6c18fd34cf29dd0ac00e81a4a8c" candidate_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1"
I20260809 12:03:32.333775 9681 raft_consensus.cc:3037] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:32.336580 9681 raft_consensus.cc:2454] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f05528ac015e4f0cb0aa748afdc2c12e in term 1.
W20260809 12:03:32.351152 9347 connection.cc:535] server connection from 127.0.0.1:45542 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:32.351243 9782 connection.cc:535] client connection to 127.8.15.124:33307 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:32.352397 9782 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.8.15.124:33307)
W20260809 12:03:32.352391 9125 connection.cc:535] server connection from 127.0.0.1:36636 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:32.352851 9782 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.8.15.124:33307)
W20260809 12:03:32.353765 9782 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.8.15.124:33307)
W20260809 12:03:32.353888 9867 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 12:03:32.351921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.15.124:33307 (local address 127.8.15.67:48221)
0809 12:03:32.352569 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0809 12:03:32.352591 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 12:03:32.352716 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 12:03:32.352898 (+ 182us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: BlockingWrite error: write error: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":491}
W20260809 12:03:32.354941 9128 connection.cc:535] client connection to 127.8.15.124:33307 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:32.355157 9782 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.8.15.124:33307)
I20260809 12:03:32.436539 9899 raft_consensus.cc:482] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:32.436787 9899 raft_consensus.cc:504] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.437536 9899 leader_election.cc:288] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723), cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479)
I20260809 12:03:32.438036 9226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12eb84afa6ce467989205478da21f1bf" candidate_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" is_pre_election: true
I20260809 12:03:32.438330 9226 raft_consensus.cc:2454] T 12eb84afa6ce467989205478da21f1bf P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0b5e4c0505c4122ae1349ee4beb5bd1 in term 0.
I20260809 12:03:32.438326 9463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12eb84afa6ce467989205478da21f1bf" candidate_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde39fbb4ced4d049fef6754c3f3e796" is_pre_election: true
I20260809 12:03:32.438606 9463 raft_consensus.cc:2454] T 12eb84afa6ce467989205478da21f1bf P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0b5e4c0505c4122ae1349ee4beb5bd1 in term 0.
I20260809 12:03:32.438920 9571 leader_election.cc:302] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1, f05528ac015e4f0cb0aa748afdc2c12e; no voters:
I20260809 12:03:32.439339 9899 raft_consensus.cc:2781] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 12:03:32.439440 9899 raft_consensus.cc:482] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 12:03:32.439533 9899 raft_consensus.cc:3037] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:32.442301 9899 raft_consensus.cc:504] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.443435 9463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12eb84afa6ce467989205478da21f1bf" candidate_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde39fbb4ced4d049fef6754c3f3e796"
I20260809 12:03:32.443688 9463 raft_consensus.cc:3037] T 12eb84afa6ce467989205478da21f1bf P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:32.446514 9463 raft_consensus.cc:2454] T 12eb84afa6ce467989205478da21f1bf P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0b5e4c0505c4122ae1349ee4beb5bd1 in term 1.
I20260809 12:03:32.446909 9226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12eb84afa6ce467989205478da21f1bf" candidate_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f05528ac015e4f0cb0aa748afdc2c12e"
I20260809 12:03:32.446970 9573 leader_election.cc:302] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cde39fbb4ced4d049fef6754c3f3e796, e0b5e4c0505c4122ae1349ee4beb5bd1; no voters:
I20260809 12:03:32.447149 9226 raft_consensus.cc:3037] T 12eb84afa6ce467989205478da21f1bf P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:32.447288 9968 raft_consensus.cc:2781] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 12:03:32.449815 9226 raft_consensus.cc:2454] T 12eb84afa6ce467989205478da21f1bf P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0b5e4c0505c4122ae1349ee4beb5bd1 in term 1.
I20260809 12:03:32.450594 9899 leader_election.cc:288] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 1 election: Requested vote from peers f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723), cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479)
I20260809 12:03:32.451732 9968 raft_consensus.cc:686] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 LEADER]: Becoming Leader. State: Replica: e0b5e4c0505c4122ae1349ee4beb5bd1, State: Running, Role: LEADER
I20260809 12:03:32.452212 9968 consensus_queue.cc:237] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.491837 9904 raft_consensus.cc:482] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:32.492079 9904 raft_consensus.cc:504] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.492817 9904 leader_election.cc:288] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723), e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:32.493415 9681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04848b966e9d454baddf302cbdb03535" candidate_uuid: "cde39fbb4ced4d049fef6754c3f3e796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" is_pre_election: true
I20260809 12:03:32.493409 9226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04848b966e9d454baddf302cbdb03535" candidate_uuid: "cde39fbb4ced4d049fef6754c3f3e796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" is_pre_election: true
I20260809 12:03:32.493671 9226 raft_consensus.cc:2454] T 04848b966e9d454baddf302cbdb03535 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cde39fbb4ced4d049fef6754c3f3e796 in term 0.
I20260809 12:03:32.493697 9681 raft_consensus.cc:2454] T 04848b966e9d454baddf302cbdb03535 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cde39fbb4ced4d049fef6754c3f3e796 in term 0.
I20260809 12:03:32.494081 9347 leader_election.cc:302] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e; no voters:
I20260809 12:03:32.494374 9904 raft_consensus.cc:2781] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 12:03:32.494462 9904 raft_consensus.cc:482] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 12:03:32.494567 9904 raft_consensus.cc:3037] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:32.496434 9904 raft_consensus.cc:504] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.497006 9904 leader_election.cc:288] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796 [CANDIDATE]: Term 1 election: Requested vote from peers f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723), e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:32.497426 9226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04848b966e9d454baddf302cbdb03535" candidate_uuid: "cde39fbb4ced4d049fef6754c3f3e796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f05528ac015e4f0cb0aa748afdc2c12e"
I20260809 12:03:32.497547 9681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04848b966e9d454baddf302cbdb03535" candidate_uuid: "cde39fbb4ced4d049fef6754c3f3e796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1"
I20260809 12:03:32.497671 9226 raft_consensus.cc:3037] T 04848b966e9d454baddf302cbdb03535 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:32.497772 9681 raft_consensus.cc:3037] T 04848b966e9d454baddf302cbdb03535 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:32.500453 9681 raft_consensus.cc:2454] T 04848b966e9d454baddf302cbdb03535 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cde39fbb4ced4d049fef6754c3f3e796 in term 1.
I20260809 12:03:32.500468 9226 raft_consensus.cc:2454] T 04848b966e9d454baddf302cbdb03535 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cde39fbb4ced4d049fef6754c3f3e796 in term 1.
I20260809 12:03:32.500864 9347 leader_election.cc:302] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e; no voters:
I20260809 12:03:32.501130 9904 raft_consensus.cc:2781] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 12:03:32.501335 9904 raft_consensus.cc:686] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 LEADER]: Becoming Leader. State: Replica: cde39fbb4ced4d049fef6754c3f3e796, State: Running, Role: LEADER
I20260809 12:03:32.501649 9904 consensus_queue.cc:237] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:32.557935 10032 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:03:32.558104 10032 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
W20260809 12:03:32.558533 9960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 12:03:32.558806 9960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 12:03:32.558934 9960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 12:03:32.559006 10032 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:03:32.559726 8786 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111) [suppressed 6 similar messages]
W20260809 12:03:32.560986 8786 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:03:32.561276 8788 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:03:32.561421 8788 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:03:32.561647 10032 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260809 12:03:32.566841 9960 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 12:03:32.566929 9960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 12:03:32.566993 9960 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 12:03:32.567063 9960 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 12:03:32.576833 9960 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.15.84:46271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:44923
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.15.126:45327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.15.126
--webserver_port=37855
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:06:41 UTC on ccycloud.quasar-bwoogy.root.comops.site
build id 4575991
ASAN enabled
I20260809 12:03:32.578169 9960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 12:03:32.580147 9960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 12:03:32.591291 10040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:32.591621 10039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:32.592468 10042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 12:03:32.592789 9960 server_base.cc:1034] running on GCE node
I20260809 12:03:32.593616 9960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 12:03:32.594978 9960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 12:03:32.596199 9960 hybrid_clock.cc:648] HybridClock initialized: now 1786277012596128 us; error 47 us; skew 500 ppm
I20260809 12:03:32.596534 9960 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 12:03:32.598732 9960 webserver.cc:460] Webserver started at http://127.8.15.126:37855/ using document root <none> and password file <none>
I20260809 12:03:32.599453 9960 fs_manager.cc:359] Metadata directory not provided
I20260809 12:03:32.599589 9960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 12:03:32.604647 9960 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260809 12:03:32.607599 10050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 12:03:32.608902 9960 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 12:03:32.609089 9960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/data,/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/wal
uuid: "abee08c3147547cc8f3379b5fc437835"
format_stamp: "Formatted at 2026-08-09 12:03:25 on dist-test-slave-21b9"
I20260809 12:03:32.610039 9960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 12:03:32.645328 9960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 12:03:32.646199 9960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 12:03:32.646493 9960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 12:03:32.664629 9960 rpc_server.cc:307] RPC server started. Bound to: 127.8.15.126:45327
I20260809 12:03:32.664649 10136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.15.126:45327 every 8 connection(s)
I20260809 12:03:32.666097 9960 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/data/info.pb
I20260809 12:03:32.673918 10137 sys_catalog.cc:263] Verifying existing consensus state
I20260809 12:03:32.674681 8253 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu as pid 9960
I20260809 12:03:32.678661 10137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835: Bootstrap starting.
I20260809 12:03:32.689672 10137 log.cc:824] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835: Log is configured to *not* fsync() on all Append() calls
I20260809 12:03:32.699725 10137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 12:03:32.700228 10137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835: Bootstrap complete.
I20260809 12:03:32.707737 10137 raft_consensus.cc:348] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:32.708595 10137 raft_consensus.cc:729] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: abee08c3147547cc8f3379b5fc437835, State: Initialized, Role: FOLLOWER
I20260809 12:03:32.709218 10137 consensus_queue.cc:260] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:32.710016 10147 sys_catalog.cc:455] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:32.710350 10147 sys_catalog.cc:458] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:32.710985 10137 sys_catalog.cc:564] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 12:03:32.723505 10168 catalog_manager.cc:1259] Loaded cluster ID: a0f048c3ad03482e99d22bfc404ede58
I20260809 12:03:32.723587 10168 catalog_manager.cc:1552] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835: loading cluster ID for follower catalog manager: success
I20260809 12:03:32.727401 10168 catalog_manager.cc:1574] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835: acquiring CA information for follower catalog manager: success
I20260809 12:03:32.743299 10168 catalog_manager.cc:1602] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 12:03:32.754012 9960 master_runner.cc:186] Error getting master registration for 127.8.15.124:33307: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111),
I20260809 12:03:32.763181 9960 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:03:32.805747 9937 consensus_queue.cc:1035] T 85bb8662f3174951bbdb45c8fcbaa975 P f05528ac015e4f0cb0aa748afdc2c12e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:32.820676 9763 heartbeater.cc:347] Connected to a master server at 127.8.15.126:45327
I20260809 12:03:32.820915 9763 heartbeater.cc:503] Master 127.8.15.126:45327 was elected leader, sending a full tablet report...
I20260809 12:03:32.822391 9896 consensus_queue.cc:1035] T 85bb8662f3174951bbdb45c8fcbaa975 P f05528ac015e4f0cb0aa748afdc2c12e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:32.823812 9298 heartbeater.cc:347] Connected to a master server at 127.8.15.126:45327
I20260809 12:03:32.829362 10072 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" instance_seqno: 1786277010606266) as {username='slave'} at 127.8.15.67:36993; Asking this server to re-register.
I20260809 12:03:32.830616 9763 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:32.830782 10069 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" instance_seqno: 1786277008701240) as {username='slave'} at 127.8.15.65:47863; Asking this server to re-register.
I20260809 12:03:32.831879 9298 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:32.832719 10069 ts_manager.cc:194] Registered new tserver with Master: e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:32.833873 9527 heartbeater.cc:347] Connected to a master server at 127.8.15.126:45327
I20260809 12:03:32.833879 10067 ts_manager.cc:194] Registered new tserver with Master: f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
I20260809 12:03:32.836582 10072 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" instance_seqno: 1786277009716171) as {username='slave'} at 127.8.15.66:36023; Asking this server to re-register.
I20260809 12:03:32.837260 9527 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:32.838599 10072 ts_manager.cc:194] Registered new tserver with Master: cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479)
I20260809 12:03:33.029275 9904 consensus_queue.cc:1035] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:33.039469 9904 consensus_queue.cc:1035] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:33.073415 9896 consensus_queue.cc:1035] T 67e9ded6eae9402a873f21c7219fed24 P f05528ac015e4f0cb0aa748afdc2c12e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:33.080578 9939 consensus_queue.cc:1035] T 67e9ded6eae9402a873f21c7219fed24 P f05528ac015e4f0cb0aa748afdc2c12e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:33.114748 9937 consensus_queue.cc:1035] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P f05528ac015e4f0cb0aa748afdc2c12e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:33.119903 9939 consensus_queue.cc:1035] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P f05528ac015e4f0cb0aa748afdc2c12e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:33.133515 9939 consensus_queue.cc:1035] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:33.138275 10200 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:03:33.138433 9937 consensus_queue.cc:1035] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:33.138863 10200 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:33.139605 10200 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:03:33.149515 8788 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:03:33.154281 10089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "061d8c3603f14343920d858e640b9dfd" candidate_term: 3 candidate_status { last_received { term: 2 index: 30 } } ignore_live_leader: false dest_uuid: "abee08c3147547cc8f3379b5fc437835" is_pre_election: true
I20260809 12:03:33.154853 10089 raft_consensus.cc:2454] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 061d8c3603f14343920d858e640b9dfd in term 1.
I20260809 12:03:33.155310 8786 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd, abee08c3147547cc8f3379b5fc437835; no voters: 1e38ce37027547efa06785b9247f59bc
I20260809 12:03:33.155580 10200 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260809 12:03:33.155690 10200 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:03:33.155764 10200 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 2 FOLLOWER]: Advancing to term 3
I20260809 12:03:33.157665 10200 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:33.158206 10200 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 3 election: Requested vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
I20260809 12:03:33.158605 10089 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "061d8c3603f14343920d858e640b9dfd" candidate_term: 3 candidate_status { last_received { term: 2 index: 30 } } ignore_live_leader: false dest_uuid: "abee08c3147547cc8f3379b5fc437835"
I20260809 12:03:33.158804 10089 raft_consensus.cc:3037] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 1 FOLLOWER]: Advancing to term 3
W20260809 12:03:33.159543 8788 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:03:33.163044 9937 consensus_queue.cc:1035] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:33.163360 10089 raft_consensus.cc:2454] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 061d8c3603f14343920d858e640b9dfd in term 3.
I20260809 12:03:33.163727 8786 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd, abee08c3147547cc8f3379b5fc437835; no voters: 1e38ce37027547efa06785b9247f59bc
I20260809 12:03:33.163992 10200 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 3 FOLLOWER]: Leader election won for term 3
I20260809 12:03:33.164485 10200 raft_consensus.cc:686] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 3 LEADER]: Becoming Leader. State: Replica: 061d8c3603f14343920d858e640b9dfd, State: Running, Role: LEADER
I20260809 12:03:33.165005 10200 consensus_queue.cc:237] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 2.30, Last appended by leader: 30, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:33.167868 10209 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 061d8c3603f14343920d858e640b9dfd. Latest consensus state: current_term: 3 leader_uuid: "061d8c3603f14343920d858e640b9dfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:33.168216 10209 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: This master's current role is: LEADER
I20260809 12:03:33.169399 10214 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 12:03:33.169466 9896 consensus_queue.cc:1035] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:33.172923 9968 consensus_queue.cc:1035] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:33.176385 10214 catalog_manager.cc:669] Loaded metadata for table default.table_da029d70439d48cc842a66906f93d903 [id=085a7a8b72ea4da2817e62d516fbcc38]
I20260809 12:03:33.176966 10214 catalog_manager.cc:669] Loaded metadata for table default.table_8ccd04aad0ba4f5480308b917eb8a12e [id=325c41115c9d4a16820f3f3e2c53ab6b]
I20260809 12:03:33.177377 10214 catalog_manager.cc:669] Loaded metadata for table default.table_e97f6ba8b3354e24926902268c43a5e3 [id=5239b7194cf944d881c8c4b6113b0dfa]
I20260809 12:03:33.177831 10214 catalog_manager.cc:669] Loaded metadata for table default.table_1692567d64f8469c8550ff24a79d3e57 [id=560f9d6ae1904b3ba73a0b3ed65fddbe]
I20260809 12:03:33.178174 10214 catalog_manager.cc:669] Loaded metadata for table default.table_22580336a00e422aab032707ca16836e [id=6999f70d421f4417b855c361afdebc21]
I20260809 12:03:33.178566 10214 catalog_manager.cc:669] Loaded metadata for table default.table_520e75ee39c74e6985dbd81c6f2e32f8 [id=78883a236d6b4026a725d3a3cc60dec1]
I20260809 12:03:33.178917 10214 catalog_manager.cc:669] Loaded metadata for table default.table_939805886d394093ad5a402efa777cb4 [id=87a2e7cf29fa4fdc8d5ea2173cdc1c2d]
I20260809 12:03:33.179337 10214 catalog_manager.cc:669] Loaded metadata for table default.table_22e16baa34234ab0a0b7841c1041884c [id=a090addd1b9f4126b16d72d49ac02669]
I20260809 12:03:33.179682 10214 catalog_manager.cc:669] Loaded metadata for table default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf]
I20260809 12:03:33.182528 10214 tablet_loader.cc:96] loaded metadata for tablet 04848b966e9d454baddf302cbdb03535 (table default.table_da029d70439d48cc842a66906f93d903 [id=085a7a8b72ea4da2817e62d516fbcc38])
I20260809 12:03:33.182898 10214 tablet_loader.cc:96] loaded metadata for tablet 12eb84afa6ce467989205478da21f1bf (table default.table_520e75ee39c74e6985dbd81c6f2e32f8 [id=78883a236d6b4026a725d3a3cc60dec1])
I20260809 12:03:33.183223 10214 tablet_loader.cc:96] loaded metadata for tablet 22df91f5859a43468782b4187bbafd45 (table default.table_22e16baa34234ab0a0b7841c1041884c [id=a090addd1b9f4126b16d72d49ac02669])
I20260809 12:03:33.183631 10214 tablet_loader.cc:96] loaded metadata for tablet 37059914646d4ae09e036e9ceaad2b11 (table default.table_e97f6ba8b3354e24926902268c43a5e3 [id=5239b7194cf944d881c8c4b6113b0dfa])
I20260809 12:03:33.183986 10214 tablet_loader.cc:96] loaded metadata for tablet 557cb8ac83f9476db501304e6024b0f0 (table default.table_22580336a00e422aab032707ca16836e [id=6999f70d421f4417b855c361afdebc21])
I20260809 12:03:33.184341 10214 tablet_loader.cc:96] loaded metadata for tablet 67e9ded6eae9402a873f21c7219fed24 (table default.table_8ccd04aad0ba4f5480308b917eb8a12e [id=325c41115c9d4a16820f3f3e2c53ab6b])
I20260809 12:03:33.184705 10214 tablet_loader.cc:96] loaded metadata for tablet 6e51d6c18fd34cf29dd0ac00e81a4a8c (table default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf])
I20260809 12:03:33.185220 10214 tablet_loader.cc:96] loaded metadata for tablet 85bb8662f3174951bbdb45c8fcbaa975 (table default.table_1692567d64f8469c8550ff24a79d3e57 [id=560f9d6ae1904b3ba73a0b3ed65fddbe])
I20260809 12:03:33.185765 10214 tablet_loader.cc:96] loaded metadata for tablet c755c68ccba04ded80a352012364af5b (table default.table_939805886d394093ad5a402efa777cb4 [id=87a2e7cf29fa4fdc8d5ea2173cdc1c2d])
I20260809 12:03:33.186054 10214 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 12:03:33.187742 10214 catalog_manager.cc:1259] Loaded cluster ID: a0f048c3ad03482e99d22bfc404ede58
I20260809 12:03:33.187827 10214 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 12:03:33.188519 9968 consensus_queue.cc:1035] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:33.189776 10214 catalog_manager.cc:1504] Loading token signing keys...
I20260809 12:03:33.192139 10214 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: Loaded TSK: 0
I20260809 12:03:33.193394 10214 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 12:03:33.194643 10214 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260809 12:03:33.195879 10214 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: -1
I20260809 12:03:33.198859 8803 catalog_manager.cc:5495] T c755c68ccba04ded80a352012364af5b P f05528ac015e4f0cb0aa748afdc2c12e reported cstate change: term changed from 0 to 1, leader changed from <none> to e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67). New cstate: current_term: 1 leader_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } }
I20260809 12:03:33.208778 10089 raft_consensus.cc:1261] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 3 FOLLOWER]: Refusing update from remote peer 061d8c3603f14343920d858e640b9dfd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 32. (index mismatch)
W20260809 12:03:33.209060 8788 consensus_peers.cc:487] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd -> Peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Couldn't send request to peer 1e38ce37027547efa06785b9247f59bc. Status: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 12:03:33.209529 10209 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 4, Time since last communication: 0.000s
I20260809 12:03:33.220875 10228 sys_catalog.cc:455] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "061d8c3603f14343920d858e640b9dfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:33.221314 10228 sys_catalog.cc:458] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:33.221920 10223 sys_catalog.cc:455] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 061d8c3603f14343920d858e640b9dfd. Latest consensus state: current_term: 3 leader_uuid: "061d8c3603f14343920d858e640b9dfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:33.222457 10223 sys_catalog.cc:458] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:33.223230 10200 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "061d8c3603f14343920d858e640b9dfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:33.223603 10200 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: This master's current role is: LEADER
I20260809 12:03:33.225047 10228 sys_catalog.cc:455] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "061d8c3603f14343920d858e640b9dfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:33.225287 10228 sys_catalog.cc:458] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:33.225541 9308 heartbeater.cc:503] Master 127.8.15.125:37165 was elected leader, sending a full tablet report...
I20260809 12:03:33.229056 8803 catalog_manager.cc:5495] T 85bb8662f3174951bbdb45c8fcbaa975 P f05528ac015e4f0cb0aa748afdc2c12e reported cstate change: term changed from 0 to 1, leader changed from <none> to f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65). New cstate: current_term: 1 leader_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } health_report { overall_health: UNKNOWN } } }
I20260809 12:03:33.232052 8803 catalog_manager.cc:5495] T 6e51d6c18fd34cf29dd0ac00e81a4a8c P f05528ac015e4f0cb0aa748afdc2c12e reported cstate change: term changed from 0 to 1, leader changed from <none> to f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65). New cstate: current_term: 1 leader_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } health_report { overall_health: UNKNOWN } } }
I20260809 12:03:33.232697 8803 catalog_manager.cc:5495] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e reported cstate change: term changed from 0 to 1, leader changed from <none> to f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65). New cstate: current_term: 1 leader_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } health_report { overall_health: HEALTHY } } }
I20260809 12:03:33.233186 8803 catalog_manager.cc:5495] T 37059914646d4ae09e036e9ceaad2b11 P f05528ac015e4f0cb0aa748afdc2c12e reported cstate change: term changed from 0 to 1, leader changed from <none> to cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66). New cstate: current_term: 1 leader_uuid: "cde39fbb4ced4d049fef6754c3f3e796" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } } }
I20260809 12:03:33.233632 8803 catalog_manager.cc:5495] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e reported cstate change: term changed from 0 to 1, leader changed from <none> to f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65). New cstate: current_term: 1 leader_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } health_report { overall_health: HEALTHY } } }
I20260809 12:03:33.235482 8802 master_service.cc:946] ReplaceTablet: received request to replace tablet 12eb84afa6ce467989205478da21f1bf from {username='slave'} at 127.0.0.1:44632
I20260809 12:03:33.236313 8801 master_service.cc:946] ReplaceTablet: received request to replace tablet c755c68ccba04ded80a352012364af5b from {username='slave'} at 127.0.0.1:44632
I20260809 12:03:33.237028 8798 master_service.cc:946] ReplaceTablet: received request to replace tablet 37059914646d4ae09e036e9ceaad2b11 from {username='slave'} at 127.0.0.1:44632
I20260809 12:03:33.237244 8800 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44632:
name: "default.Table_fb4b5b675db040ba953c86b0d8309ec3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:33.237663 8795 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44632:
table { table_name: "default.Table_22e16baa34234ab0a0b7841c1041884c" } modify_external_catalogs: true
I20260809 12:03:33.238409 8795 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44632:
table { table_name: "default.Table_22e16baa34234ab0a0b7841c1041884c" } modify_external_catalogs: true
I20260809 12:03:33.239382 8799 master_service.cc:946] ReplaceTablet: received request to replace tablet 37059914646d4ae09e036e9ceaad2b11 from {username='slave'} at 127.0.0.1:44632
I20260809 12:03:33.240242 8797 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44632:
name: "default.Table_4a9ffe7028574d44a30d91abf82ef9be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:33.241603 8793 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44632:
name: "default.Table_423f03903e0a49bca52f545faad63055"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:33.242376 8796 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44632:
name: "default.Table_ae991ee631804400852a07ac513507b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:33.243733 8803 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44632:
name: "default.Table_23a7e0a1a33a491ea66728c96d558eef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:33.244851 10225 mvcc.cc:205] Tried to move back new op lower bound from 7316590646094467072 to 7316590637094912000. Current Snapshot: MvccSnapshot[applied={T|T < 7316590646094467072}]
F20260809 12:03:33.250759 9090 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 1): 1 CREATE_TABLE default.table_badbfc92917e45a5aa60e47244ae5ff5
*** Check failure stack trace: ***
@ 0x7f4b76eba9ad google::LogMessage::Fail() at ??:0
@ 0x7f4b76ebd88a google::LogMessage::SendToLog() at ??:0
@ 0x7f4b76eba4de google::LogMessage::Flush() at ??:0
I20260809 12:03:33.258356 8798 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: Sending DeleteTablet for 3 replicas of tablet 37059914646d4ae09e036e9ceaad2b11
@ 0x7f4b76eba6d1 google::LogMessage::~LogMessage() at ??:0
I20260809 12:03:33.260429 8798 catalog_manager.cc:6565] ReplaceTablet: tablet 37059914646d4ae09e036e9ceaad2b11 deleted and replaced by tablet 76a803b3bb8844068c58fd4fc8f57e37
@ 0x7f4b8ca58ba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260809 12:03:33.274231 8799 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44632:
table { table_name: "default.Table_22580336a00e422aab032707ca16836e" } modify_external_catalogs: true
I20260809 12:03:33.274362 8798 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44632:
name: "default.Table_20e68010fb344d51ae82c39f2a5b6520"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:33.274609 8799 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44632:
table { table_name: "default.Table_22580336a00e422aab032707ca16836e" } modify_external_catalogs: true
@ 0x7f4b8ca57901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260809 12:03:33.277042 8802 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: Sending DeleteTablet for 3 replicas of tablet 12eb84afa6ce467989205478da21f1bf
I20260809 12:03:33.277479 8801 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: Sending DeleteTablet for 3 replicas of tablet c755c68ccba04ded80a352012364af5b
I20260809 12:03:33.277504 8802 catalog_manager.cc:6565] ReplaceTablet: tablet 12eb84afa6ce467989205478da21f1bf deleted and replaced by tablet f2b1d869fa714372bb2bdce7e9bcdfa8
I20260809 12:03:33.277930 8801 catalog_manager.cc:6565] ReplaceTablet: tablet c755c68ccba04ded80a352012364af5b deleted and replaced by tablet ce8a862530c448fa9c6241462a998723
I20260809 12:03:33.278173 8801 master_service.cc:946] ReplaceTablet: received request to replace tablet 85bb8662f3174951bbdb45c8fcbaa975 from {username='slave'} at 127.0.0.1:44632
I20260809 12:03:33.278748 9198 tablet_service.cc:1514] Processing DeleteTablet for tablet 37059914646d4ae09e036e9ceaad2b11 with delete_type TABLET_DATA_DELETED (replaced by tablet 76a803b3bb8844068c58fd4fc8f57e37) from {username='slave'} at 127.0.0.1:36648
I20260809 12:03:33.280736 9200 tablet_service.cc:1514] Processing DeleteTablet for tablet 12eb84afa6ce467989205478da21f1bf with delete_type TABLET_DATA_DELETED (replaced by tablet f2b1d869fa714372bb2bdce7e9bcdfa8) from {username='slave'} at 127.0.0.1:36648
I20260809 12:03:33.280787 9197 tablet_service.cc:1514] Processing DeleteTablet for tablet c755c68ccba04ded80a352012364af5b with delete_type TABLET_DATA_DELETED (replaced by tablet ce8a862530c448fa9c6241462a998723) from {username='slave'} at 127.0.0.1:36648
@ 0x7f4b8ca5e66c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260809 12:03:33.286783 8802 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44632:
table { table_name: "default.Table_e97f6ba8b3354e24926902268c43a5e3" } modify_external_catalogs: true
I20260809 12:03:33.287040 8802 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44632:
table { table_name: "default.Table_e97f6ba8b3354e24926902268c43a5e3" } modify_external_catalogs: true
@ 0x7f4b8ca5e4e9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f4b79ae4eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f4b7cdbe6db start_thread at ??:0
I20260809 12:03:33.296499 9425 tablet_service.cc:1514] Processing DeleteTablet for tablet 37059914646d4ae09e036e9ceaad2b11 with delete_type TABLET_DATA_DELETED (replaced by tablet 76a803b3bb8844068c58fd4fc8f57e37) from {username='slave'} at 127.0.0.1:45550
@ 0x7f4b75d5461f clone at ??:0
I20260809 12:03:33.296736 9427 tablet_service.cc:1514] Processing DeleteTablet for tablet 12eb84afa6ce467989205478da21f1bf with delete_type TABLET_DATA_DELETED (replaced by tablet f2b1d869fa714372bb2bdce7e9bcdfa8) from {username='slave'} at 127.0.0.1:45550
I20260809 12:03:33.296990 9423 tablet_service.cc:1514] Processing DeleteTablet for tablet c755c68ccba04ded80a352012364af5b with delete_type TABLET_DATA_DELETED (replaced by tablet ce8a862530c448fa9c6241462a998723) from {username='slave'} at 127.0.0.1:45550
I20260809 12:03:33.297721 10247 tablet_replica.cc:330] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796: stopping tablet replica
I20260809 12:03:33.297875 10247 raft_consensus.cc:2229] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 LEADER]: Raft consensus shutting down.
I20260809 12:03:33.298337 10247 raft_consensus.cc:2258] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:33.299364 10247 ts_tablet_manager.cc:1905] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:33.299832 10244 tablet_replica.cc:330] T 37059914646d4ae09e036e9ceaad2b11 P f05528ac015e4f0cb0aa748afdc2c12e: stopping tablet replica
I20260809 12:03:33.300202 10244 raft_consensus.cc:2229] T 37059914646d4ae09e036e9ceaad2b11 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 12:03:33.300498 10244 raft_consensus.cc:2258] T 37059914646d4ae09e036e9ceaad2b11 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:33.301438 10244 ts_tablet_manager.cc:1905] T 37059914646d4ae09e036e9ceaad2b11 P f05528ac015e4f0cb0aa748afdc2c12e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:33.304656 10220 consensus_queue.cc:1035] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:33.308198 10244 ts_tablet_manager.cc:1918] T 37059914646d4ae09e036e9ceaad2b11 P f05528ac015e4f0cb0aa748afdc2c12e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:33.308331 10244 log.cc:1196] T 37059914646d4ae09e036e9ceaad2b11 P f05528ac015e4f0cb0aa748afdc2c12e: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/wal/wals/37059914646d4ae09e036e9ceaad2b11
I20260809 12:03:33.308810 10244 ts_tablet_manager.cc:1939] T 37059914646d4ae09e036e9ceaad2b11 P f05528ac015e4f0cb0aa748afdc2c12e: Deleting consensus metadata
I20260809 12:03:33.309949 10244 tablet_replica.cc:330] T 12eb84afa6ce467989205478da21f1bf P f05528ac015e4f0cb0aa748afdc2c12e: stopping tablet replica
I20260809 12:03:33.310164 10244 raft_consensus.cc:2229] T 12eb84afa6ce467989205478da21f1bf P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 12:03:33.310317 10244 raft_consensus.cc:2258] T 12eb84afa6ce467989205478da21f1bf P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:33.310936 10244 ts_tablet_manager.cc:1905] T 12eb84afa6ce467989205478da21f1bf P f05528ac015e4f0cb0aa748afdc2c12e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:33.315261 10247 ts_tablet_manager.cc:1918] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:33.315435 10247 log.cc:1196] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/wal/wals/37059914646d4ae09e036e9ceaad2b11
I20260809 12:03:33.315891 10247 ts_tablet_manager.cc:1939] T 37059914646d4ae09e036e9ceaad2b11 P cde39fbb4ced4d049fef6754c3f3e796: Deleting consensus metadata
I20260809 12:03:33.316792 10244 ts_tablet_manager.cc:1918] T 12eb84afa6ce467989205478da21f1bf P f05528ac015e4f0cb0aa748afdc2c12e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260809 12:03:33.316944 10244 log.cc:1196] T 12eb84afa6ce467989205478da21f1bf P f05528ac015e4f0cb0aa748afdc2c12e: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/wal/wals/12eb84afa6ce467989205478da21f1bf
I20260809 12:03:33.316999 10247 tablet_replica.cc:330] T 12eb84afa6ce467989205478da21f1bf P cde39fbb4ced4d049fef6754c3f3e796: stopping tablet replica
I20260809 12:03:33.317272 10244 ts_tablet_manager.cc:1939] T 12eb84afa6ce467989205478da21f1bf P f05528ac015e4f0cb0aa748afdc2c12e: Deleting consensus metadata
I20260809 12:03:33.317976 10244 tablet_replica.cc:330] T c755c68ccba04ded80a352012364af5b P f05528ac015e4f0cb0aa748afdc2c12e: stopping tablet replica
I20260809 12:03:33.318120 10244 raft_consensus.cc:2229] T c755c68ccba04ded80a352012364af5b P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 12:03:33.318282 10244 raft_consensus.cc:2258] T c755c68ccba04ded80a352012364af5b P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:33.319779 10244 ts_tablet_manager.cc:1905] T c755c68ccba04ded80a352012364af5b P f05528ac015e4f0cb0aa748afdc2c12e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:33.320465 10247 raft_consensus.cc:2229] T 12eb84afa6ce467989205478da21f1bf P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 12:03:33.321874 10247 pending_rounds.cc:62] T 12eb84afa6ce467989205478da21f1bf P cde39fbb4ced4d049fef6754c3f3e796: Trying to abort 1 pending ops.
I20260809 12:03:33.322023 10247 pending_rounds.cc:68] T 12eb84afa6ce467989205478da21f1bf P cde39fbb4ced4d049fef6754c3f3e796: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316590643007586304 op_type: NO_OP noop_request { }
I20260809 12:03:33.322242 10247 raft_consensus.cc:2866] T 12eb84afa6ce467989205478da21f1bf P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260809 12:03:33.322410 10247 raft_consensus.cc:2258] T 12eb84afa6ce467989205478da21f1bf P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260809 12:03:33.322767 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260809 12:03:33.323211 10247 ts_tablet_manager.cc:1905] T 12eb84afa6ce467989205478da21f1bf P cde39fbb4ced4d049fef6754c3f3e796: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 12:03:33.327490 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 1: this message will repeat every 5th retry.
I20260809 12:03:33.328246 10244 ts_tablet_manager.cc:1918] T c755c68ccba04ded80a352012364af5b P f05528ac015e4f0cb0aa748afdc2c12e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:33.328365 10244 log.cc:1196] T c755c68ccba04ded80a352012364af5b P f05528ac015e4f0cb0aa748afdc2c12e: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/wal/wals/c755c68ccba04ded80a352012364af5b
I20260809 12:03:33.328799 10244 ts_tablet_manager.cc:1939] T c755c68ccba04ded80a352012364af5b P f05528ac015e4f0cb0aa748afdc2c12e: Deleting consensus metadata
I20260809 12:03:33.329694 10247 ts_tablet_manager.cc:1918] T 12eb84afa6ce467989205478da21f1bf P cde39fbb4ced4d049fef6754c3f3e796: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:33.329811 10247 log.cc:1196] T 12eb84afa6ce467989205478da21f1bf P cde39fbb4ced4d049fef6754c3f3e796: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/wal/wals/12eb84afa6ce467989205478da21f1bf
I20260809 12:03:33.330215 10247 ts_tablet_manager.cc:1939] T 12eb84afa6ce467989205478da21f1bf P cde39fbb4ced4d049fef6754c3f3e796: Deleting consensus metadata
I20260809 12:03:33.331007 10247 tablet_replica.cc:330] T c755c68ccba04ded80a352012364af5b P cde39fbb4ced4d049fef6754c3f3e796: stopping tablet replica
I20260809 12:03:33.331175 10247 raft_consensus.cc:2229] T c755c68ccba04ded80a352012364af5b P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 12:03:33.331348 10247 raft_consensus.cc:2258] T c755c68ccba04ded80a352012364af5b P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:33.331984 10247 ts_tablet_manager.cc:1905] T c755c68ccba04ded80a352012364af5b P cde39fbb4ced4d049fef6754c3f3e796: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:33.336092 10247 ts_tablet_manager.cc:1918] T c755c68ccba04ded80a352012364af5b P cde39fbb4ced4d049fef6754c3f3e796: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:33.336202 10247 log.cc:1196] T c755c68ccba04ded80a352012364af5b P cde39fbb4ced4d049fef6754c3f3e796: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/wal/wals/c755c68ccba04ded80a352012364af5b
I20260809 12:03:33.336462 10247 ts_tablet_manager.cc:1939] T c755c68ccba04ded80a352012364af5b P cde39fbb4ced4d049fef6754c3f3e796: Deleting consensus metadata
I20260809 12:03:33.421752 10185 consensus_queue.cc:1035] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:33.427043 10186 consensus_queue.cc:1035] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 12:03:33.483963 9125 connection.cc:535] server connection from 127.0.0.1:36648 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:33.483985 9348 connection.cc:535] server connection from 127.0.0.1:45550 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:33.484042 9571 connection.cc:535] client connection to 127.8.15.125:37165 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:33.484328 9779 connection.cc:535] client connection to 127.8.15.125:37165 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:33.484560 10239 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 12:03:33.261677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36270 (local address 127.8.15.67:34793)
0809 12:03:33.276811 (+ 15134us) server_negotiation.cc:206] Beginning negotiation
0809 12:03:33.276817 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 12:03:33.276844 (+ 27us) server_negotiation.cc:407] Connection header received
0809 12:03:33.276916 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 12:03:33.276921 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 12:03:33.277001 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 12:03:33.280810 (+ 3809us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 12:03:33.281020 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 12:03:33.285353 (+ 4333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 12:03:33.297486 (+ 12133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 12:03:33.298797 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 12:03:33.298915 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 12:03:33.299010 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 12:03:33.484164 (+185154us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36270: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":14992,"thread_start_us":15137,"threads_started":1}
W20260809 12:03:33.484854 9347 connection.cc:535] client connection to 127.8.15.125:37165 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:33.484963 9779 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.8.15.125:37165)
W20260809 12:03:33.485539 9779 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.8.15.125:37165)
W20260809 12:03:33.485824 9779 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.8.15.125:37165)
W20260809 12:03:33.486232 9867 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 12:03:33.485079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.15.125:37165 (local address 127.8.15.67:47341)
0809 12:03:33.485322 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0809 12:03:33.485341 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 12:03:33.485456 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 12:03:33.486081 (+ 625us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":126}
W20260809 12:03:33.486322 10055 connection.cc:535] server connection from 127.0.0.1:46830 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:33.486625 9123 connection.cc:535] client connection to 127.8.15.125:37165 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:33.486943 9779 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.8.15.125:37165)
W20260809 12:03:33.487793 9977 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 12:03:33.485959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.15.125:37165 (local address 127.8.15.66:49773)
0809 12:03:33.486740 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0809 12:03:33.486820 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":668}
I20260809 12:03:33.795780 10269 raft_consensus.cc:482] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 061d8c3603f14343920d858e640b9dfd)
I20260809 12:03:33.795987 10269 raft_consensus.cc:504] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:33.797752 10269 leader_election.cc:288] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:03:33.798882 10052 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
W20260809 12:03:33.800331 10055 leader_election.cc:334] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
W20260809 12:03:33.800587 10052 leader_election.cc:334] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
I20260809 12:03:33.800724 10052 leader_election.cc:302] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abee08c3147547cc8f3379b5fc437835; no voters: 061d8c3603f14343920d858e640b9dfd, 1e38ce37027547efa06785b9247f59bc
I20260809 12:03:33.801072 10269 raft_consensus.cc:2726] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260809 12:03:34.395169 9573 consensus_peers.cc:487] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c755c68ccba04ded80a352012364af5b. This is attempt 1: this message will repeat every 5th retry.
W20260809 12:03:34.435215 9571 consensus_peers.cc:487] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c755c68ccba04ded80a352012364af5b. This is attempt 1: this message will repeat every 5th retry.
I20260809 12:03:34.523922 10288 raft_consensus.cc:482] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 061d8c3603f14343920d858e640b9dfd)
I20260809 12:03:34.524122 10288 raft_consensus.cc:504] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:34.524852 10288 leader_election.cc:288] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:03:34.527143 10052 leader_election.cc:334] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
W20260809 12:03:34.527396 10055 leader_election.cc:334] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:03:34.527535 10055 leader_election.cc:302] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abee08c3147547cc8f3379b5fc437835; no voters: 061d8c3603f14343920d858e640b9dfd, 1e38ce37027547efa06785b9247f59bc
I20260809 12:03:34.527861 10288 raft_consensus.cc:2726] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260809 12:03:35.399627 8253 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
/tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.15.125:37165
--webserver_interface=127.8.15.125
--webserver_port=41665
--builtin_ntp_servers=127.8.15.84:46271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--hive_metastore_uris=thrift://127.0.0.1:44923
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260809 12:03:35.557946 10323 raft_consensus.cc:482] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 061d8c3603f14343920d858e640b9dfd)
I20260809 12:03:35.558147 10323 raft_consensus.cc:504] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:35.561162 10323 leader_election.cc:288] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:03:35.562879 10052 leader_election.cc:334] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
W20260809 12:03:35.563045 10055 leader_election.cc:334] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:03:35.563163 10055 leader_election.cc:302] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abee08c3147547cc8f3379b5fc437835; no voters: 061d8c3603f14343920d858e640b9dfd, 1e38ce37027547efa06785b9247f59bc
I20260809 12:03:35.563535 10323 raft_consensus.cc:2726] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260809 12:03:35.739494 10319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 12:03:35.739769 10319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 12:03:35.739851 10319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 12:03:35.747195 10319 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 12:03:35.747330 10319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 12:03:35.747376 10319 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 12:03:35.747431 10319 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 12:03:35.756855 10319 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.15.84:46271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:44923
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.15.125:37165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.15.125
--webserver_port=41665
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:06:41 UTC on ccycloud.quasar-bwoogy.root.comops.site
build id 4575991
ASAN enabled
I20260809 12:03:35.758239 10319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 12:03:35.760142 10319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 12:03:35.771718 10333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:35.771771 10334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:35.771984 10337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 12:03:35.772639 10319 server_base.cc:1034] running on GCE node
I20260809 12:03:35.773434 10319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 12:03:35.774924 10319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 12:03:35.776135 10319 hybrid_clock.cc:648] HybridClock initialized: now 1786277015776063 us; error 50 us; skew 500 ppm
I20260809 12:03:35.776495 10319 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 12:03:35.779217 10319 webserver.cc:460] Webserver started at http://127.8.15.125:41665/ using document root <none> and password file <none>
I20260809 12:03:35.780031 10319 fs_manager.cc:359] Metadata directory not provided
I20260809 12:03:35.780164 10319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 12:03:35.785583 10319 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.005s
I20260809 12:03:35.788684 10343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 12:03:35.790166 10319 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 12:03:35.790354 10319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data,/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/wal
uuid: "061d8c3603f14343920d858e640b9dfd"
format_stamp: "Formatted at 2026-08-09 12:03:26 on dist-test-slave-21b9"
I20260809 12:03:35.791544 10319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 12:03:35.816366 10319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 12:03:35.817268 10319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 12:03:35.817560 10319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 12:03:35.835107 10319 rpc_server.cc:307] RPC server started. Bound to: 127.8.15.125:37165
I20260809 12:03:35.835129 10425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.15.125:37165 every 8 connection(s)
I20260809 12:03:35.836732 10319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data/info.pb
I20260809 12:03:35.841001 8253 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu as pid 10319
I20260809 12:03:35.844660 10428 sys_catalog.cc:263] Verifying existing consensus state
I20260809 12:03:35.850037 10428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: Bootstrap starting.
I20260809 12:03:35.862545 10428 log.cc:824] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: Log is configured to *not* fsync() on all Append() calls
I20260809 12:03:35.891800 9308 heartbeater.cc:347] Connected to a master server at 127.8.15.125:37165
I20260809 12:03:35.896277 10428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: Bootstrap replayed 1/1 log segments. Stats: ops{read=38 overwritten=0 applied=36 ignored=0} inserts{seen=27 ignored=0} mutations{seen=26 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260809 12:03:35.896878 10428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: Bootstrap complete.
I20260809 12:03:35.904170 10428 raft_consensus.cc:348] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 3 FOLLOWER]: Replica starting. Triggering 2 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:35.908452 10428 raft_consensus.cc:729] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 061d8c3603f14343920d858e640b9dfd, State: Initialized, Role: FOLLOWER
I20260809 12:03:35.909821 10428 consensus_queue.cc:260] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 36, Last appended: 3.38, Last appended by leader: 38, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:35.911785 10442 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:35.912375 10442 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:35.913311 10428 sys_catalog.cc:564] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 12:03:35.918682 9766 heartbeater.cc:347] Connected to a master server at 127.8.15.125:37165
I20260809 12:03:35.921692 9766 heartbeater.cc:347] Connected to a master server at 127.8.15.125:37165
I20260809 12:03:35.929735 10462 catalog_manager.cc:1259] Loaded cluster ID: a0f048c3ad03482e99d22bfc404ede58
I20260809 12:03:35.929848 10462 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: loading cluster ID for follower catalog manager: success
I20260809 12:03:35.934046 10462 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: acquiring CA information for follower catalog manager: success
I20260809 12:03:35.936930 10462 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 12:03:35.965159 10319 master_runner.cc:186] Error getting master registration for 127.8.15.124:33307: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111),
I20260809 12:03:35.971108 10319 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:03:36.001737 9530 heartbeater.cc:347] Connected to a master server at 127.8.15.125:37165
I20260809 12:03:36.004644 10370 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" instance_seqno: 1786277009716171) as {username='slave'} at 127.8.15.66:53295; Asking this server to re-register.
I20260809 12:03:36.005306 9530 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:36.007032 10370 ts_manager.cc:194] Registered new tserver with Master: cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479)
I20260809 12:03:36.041613 10476 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:03:36.041848 10476 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:36.042600 10476 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:03:36.043658 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:03:36.043875 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:03:36.043987 9571 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:03:36.044255 10476 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 12:03:36.199193 10370 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" instance_seqno: 1786277010606266) as {username='slave'} at 127.8.15.67:44491; Asking this server to re-register.
I20260809 12:03:36.199968 9766 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:36.201778 10370 ts_manager.cc:194] Registered new tserver with Master: e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:36.397228 10370 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" instance_seqno: 1786277008701240) as {username='slave'} at 127.8.15.65:35987; Asking this server to re-register.
I20260809 12:03:36.397913 9308 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:36.399248 10370 ts_manager.cc:194] Registered new tserver with Master: f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
I20260809 12:03:36.411468 10485 raft_consensus.cc:482] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 061d8c3603f14343920d858e640b9dfd)
I20260809 12:03:36.411664 10485 raft_consensus.cc:504] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:36.412460 10485 leader_election.cc:288] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:03:36.414906 10055 leader_election.cc:334] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:03:36.419257 10386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "abee08c3147547cc8f3379b5fc437835" candidate_term: 4 candidate_status { last_received { term: 3 index: 37 } } ignore_live_leader: false dest_uuid: "061d8c3603f14343920d858e640b9dfd" is_pre_election: true
I20260809 12:03:36.419879 10386 raft_consensus.cc:2396] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abee08c3147547cc8f3379b5fc437835 for term 4 because replica has last-logged OpId of term: 3 index: 38, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 37.
I20260809 12:03:36.420517 10052 leader_election.cc:302] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abee08c3147547cc8f3379b5fc437835; no voters: 061d8c3603f14343920d858e640b9dfd, 1e38ce37027547efa06785b9247f59bc
I20260809 12:03:36.420819 10485 raft_consensus.cc:2726] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260809 12:03:36.471098 10489 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:36.471429 10489 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:36.473148 10489 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
I20260809 12:03:36.473773 10088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "061d8c3603f14343920d858e640b9dfd" candidate_term: 4 candidate_status { last_received { term: 3 index: 38 } } ignore_live_leader: false dest_uuid: "abee08c3147547cc8f3379b5fc437835" is_pre_election: true
I20260809 12:03:36.474009 10088 raft_consensus.cc:2454] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 061d8c3603f14343920d858e640b9dfd in term 3.
W20260809 12:03:36.474140 10351 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:03:36.474558 10349 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd, abee08c3147547cc8f3379b5fc437835; no voters:
I20260809 12:03:36.474997 10489 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260809 12:03:36.475131 10489 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 12:03:36.475234 10489 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 3 FOLLOWER]: Advancing to term 4
W20260809 12:03:36.475802 10351 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:03:36.478981 10489 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:36.479584 10489 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 4 election: Requested vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
I20260809 12:03:36.480144 10088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "061d8c3603f14343920d858e640b9dfd" candidate_term: 4 candidate_status { last_received { term: 3 index: 38 } } ignore_live_leader: false dest_uuid: "abee08c3147547cc8f3379b5fc437835"
I20260809 12:03:36.480425 10088 raft_consensus.cc:3037] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 3 FOLLOWER]: Advancing to term 4
W20260809 12:03:36.480868 10351 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:03:36.482514 10088 raft_consensus.cc:2454] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 061d8c3603f14343920d858e640b9dfd in term 4.
I20260809 12:03:36.482901 10349 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd, abee08c3147547cc8f3379b5fc437835; no voters: 1e38ce37027547efa06785b9247f59bc
I20260809 12:03:36.483155 10489 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 4 FOLLOWER]: Leader election won for term 4
I20260809 12:03:36.483544 10489 raft_consensus.cc:686] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 4 LEADER]: Becoming Leader. State: Replica: 061d8c3603f14343920d858e640b9dfd, State: Running, Role: LEADER
I20260809 12:03:36.484093 10489 consensus_queue.cc:237] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 36, Committed index: 36, Last appended: 3.38, Last appended by leader: 38, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:36.486616 10494 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 061d8c3603f14343920d858e640b9dfd. Latest consensus state: current_term: 4 leader_uuid: "061d8c3603f14343920d858e640b9dfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:36.486888 10494 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: This master's current role is: LEADER
W20260809 12:03:36.928596 10351 consensus_peers.cc:487] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd -> Peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Couldn't send request to peer 1e38ce37027547efa06785b9247f59bc. Status: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 12:03:36.974242 10088 raft_consensus.cc:1261] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 4 FOLLOWER]: Refusing update from remote peer 061d8c3603f14343920d858e640b9dfd: Log matching property violated. Preceding OpId in replica: term: 3 index: 37. Preceding OpId from leader: term: 4 index: 39. (index mismatch)
I20260809 12:03:36.975222 10494 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 39, Last known committed idx: 36, Time since last communication: 0.000s
I20260809 12:03:36.978796 10504 sys_catalog.cc:455] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 061d8c3603f14343920d858e640b9dfd. Latest consensus state: current_term: 4 leader_uuid: "061d8c3603f14343920d858e640b9dfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:36.979102 10504 sys_catalog.cc:458] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:36.982268 10489 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "061d8c3603f14343920d858e640b9dfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:36.982563 10489 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: This master's current role is: LEADER
I20260809 12:03:36.982884 10504 sys_catalog.cc:455] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "061d8c3603f14343920d858e640b9dfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:36.983124 10504 sys_catalog.cc:458] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:37.003640 10497 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 12:03:37.006429 10497 catalog_manager.cc:669] Loaded metadata for table default.table_da029d70439d48cc842a66906f93d903 [id=085a7a8b72ea4da2817e62d516fbcc38]
I20260809 12:03:37.006934 10497 catalog_manager.cc:669] Loaded metadata for table default.table_8ccd04aad0ba4f5480308b917eb8a12e [id=325c41115c9d4a16820f3f3e2c53ab6b]
I20260809 12:03:37.007357 10497 catalog_manager.cc:669] Loaded metadata for table default.table_e97f6ba8b3354e24926902268c43a5e3 [id=5239b7194cf944d881c8c4b6113b0dfa]
I20260809 12:03:37.007752 10497 catalog_manager.cc:669] Loaded metadata for table default.table_1692567d64f8469c8550ff24a79d3e57 [id=560f9d6ae1904b3ba73a0b3ed65fddbe]
I20260809 12:03:37.008126 10497 catalog_manager.cc:669] Loaded metadata for table default.table_22580336a00e422aab032707ca16836e [id=6999f70d421f4417b855c361afdebc21]
I20260809 12:03:37.008493 10497 catalog_manager.cc:669] Loaded metadata for table default.table_520e75ee39c74e6985dbd81c6f2e32f8 [id=78883a236d6b4026a725d3a3cc60dec1]
I20260809 12:03:37.008782 10497 catalog_manager.cc:669] Loaded metadata for table default.table_939805886d394093ad5a402efa777cb4 [id=87a2e7cf29fa4fdc8d5ea2173cdc1c2d]
I20260809 12:03:37.009090 10497 catalog_manager.cc:669] Loaded metadata for table default.table_22e16baa34234ab0a0b7841c1041884c [id=a090addd1b9f4126b16d72d49ac02669]
I20260809 12:03:37.009379 10497 catalog_manager.cc:669] Loaded metadata for table default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf]
I20260809 12:03:37.011883 10497 tablet_loader.cc:96] loaded metadata for tablet 04848b966e9d454baddf302cbdb03535 (table default.table_da029d70439d48cc842a66906f93d903 [id=085a7a8b72ea4da2817e62d516fbcc38])
I20260809 12:03:37.012403 10497 tablet_loader.cc:96] loaded metadata for tablet 22df91f5859a43468782b4187bbafd45 (table default.table_22e16baa34234ab0a0b7841c1041884c [id=a090addd1b9f4126b16d72d49ac02669])
I20260809 12:03:37.012851 10497 tablet_loader.cc:96] loaded metadata for tablet 557cb8ac83f9476db501304e6024b0f0 (table default.table_22580336a00e422aab032707ca16836e [id=6999f70d421f4417b855c361afdebc21])
I20260809 12:03:37.013137 10497 tablet_loader.cc:96] loaded metadata for tablet 67e9ded6eae9402a873f21c7219fed24 (table default.table_8ccd04aad0ba4f5480308b917eb8a12e [id=325c41115c9d4a16820f3f3e2c53ab6b])
I20260809 12:03:37.013445 10497 tablet_loader.cc:96] loaded metadata for tablet 6e51d6c18fd34cf29dd0ac00e81a4a8c (table default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf])
I20260809 12:03:37.013952 10497 tablet_loader.cc:96] loaded metadata for tablet 76a803b3bb8844068c58fd4fc8f57e37 (table default.table_e97f6ba8b3354e24926902268c43a5e3 [id=5239b7194cf944d881c8c4b6113b0dfa])
I20260809 12:03:37.014655 10497 tablet_loader.cc:96] loaded metadata for tablet ce8a862530c448fa9c6241462a998723 (table default.table_939805886d394093ad5a402efa777cb4 [id=87a2e7cf29fa4fdc8d5ea2173cdc1c2d])
I20260809 12:03:37.014920 10497 tablet_loader.cc:96] loaded metadata for tablet d8214eed04f14bd5bbe3a79b549fa71c (table default.table_1692567d64f8469c8550ff24a79d3e57 [id=560f9d6ae1904b3ba73a0b3ed65fddbe])
I20260809 12:03:37.015129 10497 tablet_loader.cc:96] loaded metadata for tablet f2b1d869fa714372bb2bdce7e9bcdfa8 (table default.table_520e75ee39c74e6985dbd81c6f2e32f8 [id=78883a236d6b4026a725d3a3cc60dec1])
I20260809 12:03:37.015406 10497 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 12:03:37.016435 10497 catalog_manager.cc:1259] Loaded cluster ID: a0f048c3ad03482e99d22bfc404ede58
I20260809 12:03:37.016518 10497 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 12:03:37.017850 10497 catalog_manager.cc:1504] Loading token signing keys...
I20260809 12:03:37.018837 10497 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: Loaded TSK: 0
I20260809 12:03:37.019804 10497 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 12:03:37.020768 10497 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260809 12:03:37.021646 10497 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: -1
I20260809 12:03:37.091351 10370 master_service.cc:946] ReplaceTablet: received request to replace tablet 04848b966e9d454baddf302cbdb03535 from {username='slave'} at 127.0.0.1:45278
I20260809 12:03:37.091444 10369 master_service.cc:946] ReplaceTablet: received request to replace tablet 22df91f5859a43468782b4187bbafd45 from {username='slave'} at 127.0.0.1:45278
I20260809 12:03:37.091874 10368 master_service.cc:946] ReplaceTablet: received request to replace tablet 557cb8ac83f9476db501304e6024b0f0 from {username='slave'} at 127.0.0.1:45278
I20260809 12:03:37.092433 10363 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45278:
table { table_name: "default.Table_5e7b5144853246789d8fc5da01626dc7" } new_table_name: "default.Table_c9c43a2a0d1a4e209f094445b8de091c" modify_external_catalogs: true
I20260809 12:03:37.093070 10367 master_service.cc:946] ReplaceTablet: received request to replace tablet 557cb8ac83f9476db501304e6024b0f0 from {username='slave'} at 127.0.0.1:45278
I20260809 12:03:37.095525 10359 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45278:
table { table_name: "default.Table_da029d70439d48cc842a66906f93d903" } new_table_name: "default.Table_4bc23e8b582a43d38648468e3b9f8237" modify_external_catalogs: true
I20260809 12:03:37.094327 10362 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45278:
table { table_name: "default.Table_1692567d64f8469c8550ff24a79d3e57" } new_table_name: "default.Table_e53628efaa614b888fbce28b06e96b27" modify_external_catalogs: true
I20260809 12:03:37.097782 10360 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45278:
name: "default.Table_a20494e2c08645f2b8321fd1681d3551"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:37.096774 10365 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45278:
name: "default.Table_32063c5c554f4148b27ed449777518f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:37.097875 10361 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45278:
name: "default.Table_98748f90a4da4969b9f519b8b02d21a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
F20260809 12:03:37.101534 10461 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 1): 1 CREATE_TABLE default.table_badbfc92917e45a5aa60e47244ae5ff5
*** Check failure stack trace: ***
@ 0x7f88143a29ad google::LogMessage::Fail() at ??:0
@ 0x7f88143a588a google::LogMessage::SendToLog() at ??:0
I20260809 12:03:37.106070 10370 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: Sending DeleteTablet for 3 replicas of tablet 04848b966e9d454baddf302cbdb03535
@ 0x7f88143a24de google::LogMessage::Flush() at ??:0
I20260809 12:03:37.108541 10370 catalog_manager.cc:6565] ReplaceTablet: tablet 04848b966e9d454baddf302cbdb03535 deleted and replaced by tablet 2e7c9b8049094f84ab877baba38947c8
I20260809 12:03:37.109094 10370 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45278:
table { table_name: "default.Table_8ccd04aad0ba4f5480308b917eb8a12e" } new_table_name: "default.Table_489095aac0bc4bfaa46526a3f3a1f487" modify_external_catalogs: true
@ 0x7f88143a26d1 google::LogMessage::~LogMessage() at ??:0
I20260809 12:03:37.129781 10369 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: Sending DeleteTablet for 3 replicas of tablet 22df91f5859a43468782b4187bbafd45
I20260809 12:03:37.130100 10368 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: Sending DeleteTablet for 3 replicas of tablet 557cb8ac83f9476db501304e6024b0f0
I20260809 12:03:37.130343 10369 catalog_manager.cc:6565] ReplaceTablet: tablet 22df91f5859a43468782b4187bbafd45 deleted and replaced by tablet 3366ce108f824dc2a04e38b230c4ba88
I20260809 12:03:37.130563 10368 catalog_manager.cc:6565] ReplaceTablet: tablet 557cb8ac83f9476db501304e6024b0f0 deleted and replaced by tablet 013985779fe948f5b8a226502497aa2f
I20260809 12:03:37.130781 10369 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45278:
table { table_name: "default.Table_939805886d394093ad5a402efa777cb4" } new_table_name: "default.Table_fde2047ff905432799357dc11e5e179a" modify_external_catalogs: true
I20260809 12:03:37.130987 10368 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45278:
name: "default.Table_4a9ffe7028574d44a30d91abf82ef9be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:37.132134 10367 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45278:
name: "default.Table_fb4b5b675db040ba953c86b0d8309ec3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
@ 0x7f8829f40ba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260809 12:03:37.142983 9425 tablet_service.cc:1514] Processing DeleteTablet for tablet 04848b966e9d454baddf302cbdb03535 with delete_type TABLET_DATA_DELETED (replaced by tablet 2e7c9b8049094f84ab877baba38947c8) from {username='slave'} at 127.0.0.1:44236
I20260809 12:03:37.143860 9423 tablet_service.cc:1514] Processing DeleteTablet for tablet 22df91f5859a43468782b4187bbafd45 with delete_type TABLET_DATA_DELETED (replaced by tablet 3366ce108f824dc2a04e38b230c4ba88) from {username='slave'} at 127.0.0.1:44236
I20260809 12:03:37.144383 9427 tablet_service.cc:1514] Processing DeleteTablet for tablet 557cb8ac83f9476db501304e6024b0f0 with delete_type TABLET_DATA_DELETED (replaced by tablet 013985779fe948f5b8a226502497aa2f) from {username='slave'} at 127.0.0.1:44236
I20260809 12:03:37.145061 9421 tablet_service.cc:1467] Processing CreateTablet for tablet f2b1d869fa714372bb2bdce7e9bcdfa8 (DEFAULT_TABLE table=default.table_520e75ee39c74e6985dbd81c6f2e32f8 [id=78883a236d6b4026a725d3a3cc60dec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:37.145510 10531 tablet_replica.cc:330] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796: stopping tablet replica
I20260809 12:03:37.145560 9425 tablet_service.cc:1467] Processing CreateTablet for tablet ce8a862530c448fa9c6241462a998723 (DEFAULT_TABLE table=default.table_939805886d394093ad5a402efa777cb4 [id=87a2e7cf29fa4fdc8d5ea2173cdc1c2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:37.145645 9421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2b1d869fa714372bb2bdce7e9bcdfa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:37.145730 10531 raft_consensus.cc:2229] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 LEADER]: Raft consensus shutting down.
I20260809 12:03:37.145938 9425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce8a862530c448fa9c6241462a998723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:37.146155 10531 raft_consensus.cc:2258] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:37.147197 10531 ts_tablet_manager.cc:1905] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:37.151892 9427 tablet_service.cc:1467] Processing CreateTablet for tablet d8214eed04f14bd5bbe3a79b549fa71c (DEFAULT_TABLE table=default.table_1692567d64f8469c8550ff24a79d3e57 [id=560f9d6ae1904b3ba73a0b3ed65fddbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:37.152297 9427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8214eed04f14bd5bbe3a79b549fa71c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:37.153589 10531 ts_tablet_manager.cc:1918] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:37.153740 10531 log.cc:1196] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/wal/wals/04848b966e9d454baddf302cbdb03535
I20260809 12:03:37.154289 10531 ts_tablet_manager.cc:1939] T 04848b966e9d454baddf302cbdb03535 P cde39fbb4ced4d049fef6754c3f3e796: Deleting consensus metadata
I20260809 12:03:37.154505 10536 tablet_bootstrap.cc:492] T f2b1d869fa714372bb2bdce7e9bcdfa8 P cde39fbb4ced4d049fef6754c3f3e796: Bootstrap starting.
I20260809 12:03:37.154714 9423 tablet_service.cc:1467] Processing CreateTablet for tablet 2e7c9b8049094f84ab877baba38947c8 (DEFAULT_TABLE table=default.table_da029d70439d48cc842a66906f93d903 [id=085a7a8b72ea4da2817e62d516fbcc38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:37.155153 9423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e7c9b8049094f84ab877baba38947c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:37.155659 10531 tablet_replica.cc:330] T 22df91f5859a43468782b4187bbafd45 P cde39fbb4ced4d049fef6754c3f3e796: stopping tablet replica
I20260809 12:03:37.156265 10531 raft_consensus.cc:2229] T 22df91f5859a43468782b4187bbafd45 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 12:03:37.156517 10531 raft_consensus.cc:2258] T 22df91f5859a43468782b4187bbafd45 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:37.157274 10536 tablet_bootstrap.cc:654] T f2b1d869fa714372bb2bdce7e9bcdfa8 P cde39fbb4ced4d049fef6754c3f3e796: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:37.159103 10531 ts_tablet_manager.cc:1905] T 22df91f5859a43468782b4187bbafd45 P cde39fbb4ced4d049fef6754c3f3e796: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:37.161424 10349 catalog_manager.cc:4841] TS cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): tablet 04848b966e9d454baddf302cbdb03535 (table default.table_da029d70439d48cc842a66906f93d903 [id=085a7a8b72ea4da2817e62d516fbcc38]) successfully deleted
I20260809 12:03:37.165122 10531 ts_tablet_manager.cc:1918] T 22df91f5859a43468782b4187bbafd45 P cde39fbb4ced4d049fef6754c3f3e796: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:37.165267 10531 log.cc:1196] T 22df91f5859a43468782b4187bbafd45 P cde39fbb4ced4d049fef6754c3f3e796: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/wal/wals/22df91f5859a43468782b4187bbafd45
I20260809 12:03:37.165712 10531 ts_tablet_manager.cc:1939] T 22df91f5859a43468782b4187bbafd45 P cde39fbb4ced4d049fef6754c3f3e796: Deleting consensus metadata
I20260809 12:03:37.166198 9425 tablet_service.cc:1467] Processing CreateTablet for tablet 013985779fe948f5b8a226502497aa2f (DEFAULT_TABLE table=default.table_22580336a00e422aab032707ca16836e [id=6999f70d421f4417b855c361afdebc21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:37.166627 9425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 013985779fe948f5b8a226502497aa2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:37.166833 10536 tablet_bootstrap.cc:492] T f2b1d869fa714372bb2bdce7e9bcdfa8 P cde39fbb4ced4d049fef6754c3f3e796: No bootstrap required, opened a new log
I20260809 12:03:37.167059 10536 ts_tablet_manager.cc:1397] T f2b1d869fa714372bb2bdce7e9bcdfa8 P cde39fbb4ced4d049fef6754c3f3e796: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.007s
I20260809 12:03:37.167387 9647 tablet_service.cc:1514] Processing DeleteTablet for tablet 22df91f5859a43468782b4187bbafd45 with delete_type TABLET_DATA_DELETED (replaced by tablet 3366ce108f824dc2a04e38b230c4ba88) from {username='slave'} at 127.0.0.1:56438
I20260809 12:03:37.167456 9649 tablet_service.cc:1514] Processing DeleteTablet for tablet 04848b966e9d454baddf302cbdb03535 with delete_type TABLET_DATA_DELETED (replaced by tablet 2e7c9b8049094f84ab877baba38947c8) from {username='slave'} at 127.0.0.1:56438
I20260809 12:03:37.167917 9646 tablet_service.cc:1514] Processing DeleteTablet for tablet 557cb8ac83f9476db501304e6024b0f0 with delete_type TABLET_DATA_DELETED (replaced by tablet 013985779fe948f5b8a226502497aa2f) from {username='slave'} at 127.0.0.1:56438
I20260809 12:03:37.168423 9643 tablet_service.cc:1467] Processing CreateTablet for tablet 2e7c9b8049094f84ab877baba38947c8 (DEFAULT_TABLE table=default.table_da029d70439d48cc842a66906f93d903 [id=085a7a8b72ea4da2817e62d516fbcc38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:37.168545 9646 tablet_service.cc:1467] Processing CreateTablet for tablet f2b1d869fa714372bb2bdce7e9bcdfa8 (DEFAULT_TABLE table=default.table_520e75ee39c74e6985dbd81c6f2e32f8 [id=78883a236d6b4026a725d3a3cc60dec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:37.168758 9649 tablet_service.cc:1467] Processing CreateTablet for tablet ce8a862530c448fa9c6241462a998723 (DEFAULT_TABLE table=default.table_939805886d394093ad5a402efa777cb4 [id=87a2e7cf29fa4fdc8d5ea2173cdc1c2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:37.168902 9643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e7c9b8049094f84ab877baba38947c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:37.169116 9649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce8a862530c448fa9c6241462a998723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:37.169386 9423 tablet_service.cc:1467] Processing CreateTablet for tablet 3366ce108f824dc2a04e38b230c4ba88 (DEFAULT_TABLE table=default.table_22e16baa34234ab0a0b7841c1041884c [id=a090addd1b9f4126b16d72d49ac02669]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:37.169377 9641 tablet_service.cc:1467] Processing CreateTablet for tablet d8214eed04f14bd5bbe3a79b549fa71c (DEFAULT_TABLE table=default.table_1692567d64f8469c8550ff24a79d3e57 [id=560f9d6ae1904b3ba73a0b3ed65fddbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:37.169780 9423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3366ce108f824dc2a04e38b230c4ba88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:37.169863 9641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8214eed04f14bd5bbe3a79b549fa71c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:37.172068 9640 tablet_service.cc:1467] Processing CreateTablet for tablet 3366ce108f824dc2a04e38b230c4ba88 (DEFAULT_TABLE table=default.table_22e16baa34234ab0a0b7841c1041884c [id=a090addd1b9f4126b16d72d49ac02669]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:37.172518 9640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3366ce108f824dc2a04e38b230c4ba88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:37.174357 9646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2b1d869fa714372bb2bdce7e9bcdfa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:37.174990 9200 tablet_service.cc:1514] Processing DeleteTablet for tablet 557cb8ac83f9476db501304e6024b0f0 with delete_type TABLET_DATA_DELETED (replaced by tablet 013985779fe948f5b8a226502497aa2f) from {username='slave'} at 127.0.0.1:41256
I20260809 12:03:37.175444 9198 tablet_service.cc:1514] Processing DeleteTablet for tablet 04848b966e9d454baddf302cbdb03535 with delete_type TABLET_DATA_DELETED (replaced by tablet 2e7c9b8049094f84ab877baba38947c8) from {username='slave'} at 127.0.0.1:41256
I20260809 12:03:37.175679 9634 tablet_service.cc:1467] Processing CreateTablet for tablet 013985779fe948f5b8a226502497aa2f (DEFAULT_TABLE table=default.table_22580336a00e422aab032707ca16836e [id=6999f70d421f4417b855c361afdebc21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:37.176129 9634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 013985779fe948f5b8a226502497aa2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:37.176200 9198 tablet_service.cc:1467] Processing CreateTablet for tablet d8214eed04f14bd5bbe3a79b549fa71c (DEFAULT_TABLE table=default.table_1692567d64f8469c8550ff24a79d3e57 [id=560f9d6ae1904b3ba73a0b3ed65fddbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:37.176573 9198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8214eed04f14bd5bbe3a79b549fa71c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:37.180445 9195 tablet_service.cc:1467] Processing CreateTablet for tablet ce8a862530c448fa9c6241462a998723 (DEFAULT_TABLE table=default.table_939805886d394093ad5a402efa777cb4 [id=87a2e7cf29fa4fdc8d5ea2173cdc1c2d]), partition=RANGE (key) PARTITION UNBOUNDED
@ 0x7f8829f3f901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260809 12:03:37.180900 9195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce8a862530c448fa9c6241462a998723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:37.183683 9197 tablet_service.cc:1514] Processing DeleteTablet for tablet 22df91f5859a43468782b4187bbafd45 with delete_type TABLET_DATA_DELETED (replaced by tablet 3366ce108f824dc2a04e38b230c4ba88) from {username='slave'} at 127.0.0.1:41256
@ 0x7f8829f4666c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260809 12:03:37.186281 9193 tablet_service.cc:1467] Processing CreateTablet for tablet f2b1d869fa714372bb2bdce7e9bcdfa8 (DEFAULT_TABLE table=default.table_520e75ee39c74e6985dbd81c6f2e32f8 [id=78883a236d6b4026a725d3a3cc60dec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:37.186797 9193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2b1d869fa714372bb2bdce7e9bcdfa8. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f8829f464e9 std::_Function_handler<>::_M_invoke() at ??:0
I20260809 12:03:37.190956 10542 tablet_replica.cc:330] T 22df91f5859a43468782b4187bbafd45 P e0b5e4c0505c4122ae1349ee4beb5bd1: stopping tablet replica
I20260809 12:03:37.191165 10542 raft_consensus.cc:2229] T 22df91f5859a43468782b4187bbafd45 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 12:03:37.191475 10542 raft_consensus.cc:2258] T 22df91f5859a43468782b4187bbafd45 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Raft consensus is shut down!
@ 0x9edb7d std::function<>::operator()() at ??:?
I20260809 12:03:37.191823 9194 tablet_service.cc:1467] Processing CreateTablet for tablet 2e7c9b8049094f84ab877baba38947c8 (DEFAULT_TABLE table=default.table_da029d70439d48cc842a66906f93d903 [id=085a7a8b72ea4da2817e62d516fbcc38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:37.192103 10542 ts_tablet_manager.cc:1905] T 22df91f5859a43468782b4187bbafd45 P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:37.192246 9194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e7c9b8049094f84ab877baba38947c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 12:03:37.195725 9192 tablet_service.cc:1467] Processing CreateTablet for tablet 3366ce108f824dc2a04e38b230c4ba88 (DEFAULT_TABLE table=default.table_22e16baa34234ab0a0b7841c1041884c [id=a090addd1b9f4126b16d72d49ac02669]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:37.195946 10546 tablet_bootstrap.cc:492] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1: Bootstrap starting.
I20260809 12:03:37.196169 9192 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3366ce108f824dc2a04e38b230c4ba88. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f8816fcceaf kudu::Thread::SuperviseThread() at ??:0
I20260809 12:03:37.197788 10546 tablet_bootstrap.cc:654] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:37.198529 10349 catalog_manager.cc:4841] TS cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): tablet 22df91f5859a43468782b4187bbafd45 (table default.table_22e16baa34234ab0a0b7841c1041884c [id=a090addd1b9f4126b16d72d49ac02669]) successfully deleted
@ 0x7f881a2a66db start_thread at ??:0
I20260809 12:03:37.199636 10531 tablet_replica.cc:330] T 557cb8ac83f9476db501304e6024b0f0 P cde39fbb4ced4d049fef6754c3f3e796: stopping tablet replica
I20260809 12:03:37.199688 9190 tablet_service.cc:1467] Processing CreateTablet for tablet 013985779fe948f5b8a226502497aa2f (DEFAULT_TABLE table=default.table_22580336a00e422aab032707ca16836e [id=6999f70d421f4417b855c361afdebc21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 12:03:37.199834 10531 raft_consensus.cc:2229] T 557cb8ac83f9476db501304e6024b0f0 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 12:03:37.200039 10531 raft_consensus.cc:2258] T 557cb8ac83f9476db501304e6024b0f0 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:37.200107 9190 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 013985779fe948f5b8a226502497aa2f. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f881323c61f clone at ??:0
I20260809 12:03:37.200584 10531 ts_tablet_manager.cc:1905] T 557cb8ac83f9476db501304e6024b0f0 P cde39fbb4ced4d049fef6754c3f3e796: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:37.202936 10542 ts_tablet_manager.cc:1918] T 22df91f5859a43468782b4187bbafd45 P e0b5e4c0505c4122ae1349ee4beb5bd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:37.203052 10542 log.cc:1196] T 22df91f5859a43468782b4187bbafd45 P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/wal/wals/22df91f5859a43468782b4187bbafd45
I20260809 12:03:37.204883 10542 ts_tablet_manager.cc:1939] T 22df91f5859a43468782b4187bbafd45 P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting consensus metadata
I20260809 12:03:37.206616 10543 tablet_replica.cc:330] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e: stopping tablet replica
I20260809 12:03:37.206852 10543 raft_consensus.cc:2229] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 LEADER]: Raft consensus shutting down.
I20260809 12:03:37.207113 10542 tablet_replica.cc:330] T 04848b966e9d454baddf302cbdb03535 P e0b5e4c0505c4122ae1349ee4beb5bd1: stopping tablet replica
I20260809 12:03:37.207333 10542 raft_consensus.cc:2229] T 04848b966e9d454baddf302cbdb03535 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 12:03:37.207383 10543 raft_consensus.cc:2258] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:37.207530 10542 raft_consensus.cc:2258] T 04848b966e9d454baddf302cbdb03535 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:37.208004 10543 ts_tablet_manager.cc:1905] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:37.208093 10542 ts_tablet_manager.cc:1905] T 04848b966e9d454baddf302cbdb03535 P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:37.219787 10536 raft_consensus.cc:348] T f2b1d869fa714372bb2bdce7e9bcdfa8 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.220050 10536 raft_consensus.cc:374] T f2b1d869fa714372bb2bdce7e9bcdfa8 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:37.220131 10536 raft_consensus.cc:729] T f2b1d869fa714372bb2bdce7e9bcdfa8 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cde39fbb4ced4d049fef6754c3f3e796, State: Initialized, Role: FOLLOWER
I20260809 12:03:37.220436 10543 ts_tablet_manager.cc:1918] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:37.220533 10542 ts_tablet_manager.cc:1918] T 04848b966e9d454baddf302cbdb03535 P e0b5e4c0505c4122ae1349ee4beb5bd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:37.220400 10536 consensus_queue.cc:260] T f2b1d869fa714372bb2bdce7e9bcdfa8 P cde39fbb4ced4d049fef6754c3f3e796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.220597 10543 log.cc:1196] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/wal/wals/557cb8ac83f9476db501304e6024b0f0
I20260809 12:03:37.220675 10542 log.cc:1196] T 04848b966e9d454baddf302cbdb03535 P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/wal/wals/04848b966e9d454baddf302cbdb03535
I20260809 12:03:37.221115 10543 ts_tablet_manager.cc:1939] T 557cb8ac83f9476db501304e6024b0f0 P f05528ac015e4f0cb0aa748afdc2c12e: Deleting consensus metadata
I20260809 12:03:37.221131 10542 ts_tablet_manager.cc:1939] T 04848b966e9d454baddf302cbdb03535 P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting consensus metadata
I20260809 12:03:37.222204 10543 tablet_replica.cc:330] T 04848b966e9d454baddf302cbdb03535 P f05528ac015e4f0cb0aa748afdc2c12e: stopping tablet replica
I20260809 12:03:37.222463 10543 raft_consensus.cc:2229] T 04848b966e9d454baddf302cbdb03535 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 12:03:37.222653 10543 raft_consensus.cc:2258] T 04848b966e9d454baddf302cbdb03535 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:37.223361 10543 ts_tablet_manager.cc:1905] T 04848b966e9d454baddf302cbdb03535 P f05528ac015e4f0cb0aa748afdc2c12e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:37.223454 10531 ts_tablet_manager.cc:1918] T 557cb8ac83f9476db501304e6024b0f0 P cde39fbb4ced4d049fef6754c3f3e796: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:37.223573 10531 log.cc:1196] T 557cb8ac83f9476db501304e6024b0f0 P cde39fbb4ced4d049fef6754c3f3e796: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/wal/wals/557cb8ac83f9476db501304e6024b0f0
I20260809 12:03:37.223994 10531 ts_tablet_manager.cc:1939] T 557cb8ac83f9476db501304e6024b0f0 P cde39fbb4ced4d049fef6754c3f3e796: Deleting consensus metadata
I20260809 12:03:37.225589 10553 tablet_bootstrap.cc:492] T ce8a862530c448fa9c6241462a998723 P f05528ac015e4f0cb0aa748afdc2c12e: Bootstrap starting.
I20260809 12:03:37.225603 10536 ts_tablet_manager.cc:1428] T f2b1d869fa714372bb2bdce7e9bcdfa8 P cde39fbb4ced4d049fef6754c3f3e796: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260809 12:03:37.226003 10536 tablet_bootstrap.cc:492] T d8214eed04f14bd5bbe3a79b549fa71c P cde39fbb4ced4d049fef6754c3f3e796: Bootstrap starting.
I20260809 12:03:37.227383 10553 tablet_bootstrap.cc:654] T ce8a862530c448fa9c6241462a998723 P f05528ac015e4f0cb0aa748afdc2c12e: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:37.227785 10536 tablet_bootstrap.cc:654] T d8214eed04f14bd5bbe3a79b549fa71c P cde39fbb4ced4d049fef6754c3f3e796: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:37.233004 10542 tablet_replica.cc:330] T 557cb8ac83f9476db501304e6024b0f0 P e0b5e4c0505c4122ae1349ee4beb5bd1: stopping tablet replica
I20260809 12:03:37.233217 10542 raft_consensus.cc:2229] T 557cb8ac83f9476db501304e6024b0f0 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 12:03:37.233417 10542 raft_consensus.cc:2258] T 557cb8ac83f9476db501304e6024b0f0 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:37.234004 10542 ts_tablet_manager.cc:1905] T 557cb8ac83f9476db501304e6024b0f0 P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:37.234193 10543 ts_tablet_manager.cc:1918] T 04848b966e9d454baddf302cbdb03535 P f05528ac015e4f0cb0aa748afdc2c12e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:37.234351 10543 log.cc:1196] T 04848b966e9d454baddf302cbdb03535 P f05528ac015e4f0cb0aa748afdc2c12e: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/wal/wals/04848b966e9d454baddf302cbdb03535
I20260809 12:03:37.234840 10543 ts_tablet_manager.cc:1939] T 04848b966e9d454baddf302cbdb03535 P f05528ac015e4f0cb0aa748afdc2c12e: Deleting consensus metadata
I20260809 12:03:37.235872 10543 tablet_replica.cc:330] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e: stopping tablet replica
I20260809 12:03:37.236070 10543 raft_consensus.cc:2229] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 LEADER]: Raft consensus shutting down.
I20260809 12:03:37.236469 10543 raft_consensus.cc:2258] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:37.237056 10543 ts_tablet_manager.cc:1905] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:37.237681 10553 tablet_bootstrap.cc:492] T ce8a862530c448fa9c6241462a998723 P f05528ac015e4f0cb0aa748afdc2c12e: No bootstrap required, opened a new log
I20260809 12:03:37.237816 10553 ts_tablet_manager.cc:1397] T ce8a862530c448fa9c6241462a998723 P f05528ac015e4f0cb0aa748afdc2c12e: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.011s
I20260809 12:03:37.238685 10553 raft_consensus.cc:348] T ce8a862530c448fa9c6241462a998723 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.238947 10553 raft_consensus.cc:374] T ce8a862530c448fa9c6241462a998723 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:37.239053 10553 raft_consensus.cc:729] T ce8a862530c448fa9c6241462a998723 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f05528ac015e4f0cb0aa748afdc2c12e, State: Initialized, Role: FOLLOWER
I20260809 12:03:37.239342 10553 consensus_queue.cc:260] T ce8a862530c448fa9c6241462a998723 P f05528ac015e4f0cb0aa748afdc2c12e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.242412 10542 ts_tablet_manager.cc:1918] T 557cb8ac83f9476db501304e6024b0f0 P e0b5e4c0505c4122ae1349ee4beb5bd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:37.242545 10542 log.cc:1196] T 557cb8ac83f9476db501304e6024b0f0 P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/wal/wals/557cb8ac83f9476db501304e6024b0f0
I20260809 12:03:37.242934 10542 ts_tablet_manager.cc:1939] T 557cb8ac83f9476db501304e6024b0f0 P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting consensus metadata
I20260809 12:03:37.243024 10536 tablet_bootstrap.cc:492] T d8214eed04f14bd5bbe3a79b549fa71c P cde39fbb4ced4d049fef6754c3f3e796: No bootstrap required, opened a new log
I20260809 12:03:37.243185 10536 ts_tablet_manager.cc:1397] T d8214eed04f14bd5bbe3a79b549fa71c P cde39fbb4ced4d049fef6754c3f3e796: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.000s
I20260809 12:03:37.244036 10536 raft_consensus.cc:348] T d8214eed04f14bd5bbe3a79b549fa71c P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.244287 10536 raft_consensus.cc:374] T d8214eed04f14bd5bbe3a79b549fa71c P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:37.244359 10536 raft_consensus.cc:729] T d8214eed04f14bd5bbe3a79b549fa71c P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cde39fbb4ced4d049fef6754c3f3e796, State: Initialized, Role: FOLLOWER
I20260809 12:03:37.244583 10536 consensus_queue.cc:260] T d8214eed04f14bd5bbe3a79b549fa71c P cde39fbb4ced4d049fef6754c3f3e796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.244876 10546 tablet_bootstrap.cc:492] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1: No bootstrap required, opened a new log
I20260809 12:03:37.245028 10546 ts_tablet_manager.cc:1397] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent bootstrapping tablet: real 0.049s user 0.000s sys 0.015s
I20260809 12:03:37.245134 10536 ts_tablet_manager.cc:1428] T d8214eed04f14bd5bbe3a79b549fa71c P cde39fbb4ced4d049fef6754c3f3e796: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 12:03:37.245894 10546 raft_consensus.cc:348] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.246165 10546 raft_consensus.cc:374] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:37.246255 10546 raft_consensus.cc:729] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0b5e4c0505c4122ae1349ee4beb5bd1, State: Initialized, Role: FOLLOWER
I20260809 12:03:37.246513 10546 consensus_queue.cc:260] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.247025 10543 ts_tablet_manager.cc:1918] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:37.247053 10553 ts_tablet_manager.cc:1428] T ce8a862530c448fa9c6241462a998723 P f05528ac015e4f0cb0aa748afdc2c12e: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260809 12:03:37.247195 10543 log.cc:1196] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/wal/wals/22df91f5859a43468782b4187bbafd45
I20260809 12:03:37.247494 10553 tablet_bootstrap.cc:492] T 013985779fe948f5b8a226502497aa2f P f05528ac015e4f0cb0aa748afdc2c12e: Bootstrap starting.
I20260809 12:03:37.247742 10543 ts_tablet_manager.cc:1939] T 22df91f5859a43468782b4187bbafd45 P f05528ac015e4f0cb0aa748afdc2c12e: Deleting consensus metadata
I20260809 12:03:37.249202 10553 tablet_bootstrap.cc:654] T 013985779fe948f5b8a226502497aa2f P f05528ac015e4f0cb0aa748afdc2c12e: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:37.251966 10536 tablet_bootstrap.cc:492] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796: Bootstrap starting.
I20260809 12:03:37.252207 10546 ts_tablet_manager.cc:1428] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent starting tablet: real 0.007s user 0.000s sys 0.005s
I20260809 12:03:37.252521 10546 tablet_bootstrap.cc:492] T 2e7c9b8049094f84ab877baba38947c8 P e0b5e4c0505c4122ae1349ee4beb5bd1: Bootstrap starting.
I20260809 12:03:37.253667 10536 tablet_bootstrap.cc:654] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:37.254243 10546 tablet_bootstrap.cc:654] T 2e7c9b8049094f84ab877baba38947c8 P e0b5e4c0505c4122ae1349ee4beb5bd1: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:37.255656 10553 tablet_bootstrap.cc:492] T 013985779fe948f5b8a226502497aa2f P f05528ac015e4f0cb0aa748afdc2c12e: No bootstrap required, opened a new log
I20260809 12:03:37.255811 10553 ts_tablet_manager.cc:1397] T 013985779fe948f5b8a226502497aa2f P f05528ac015e4f0cb0aa748afdc2c12e: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260809 12:03:37.256551 10553 raft_consensus.cc:348] T 013985779fe948f5b8a226502497aa2f P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.256788 10553 raft_consensus.cc:374] T 013985779fe948f5b8a226502497aa2f P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:37.256863 10553 raft_consensus.cc:729] T 013985779fe948f5b8a226502497aa2f P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f05528ac015e4f0cb0aa748afdc2c12e, State: Initialized, Role: FOLLOWER
I20260809 12:03:37.257090 10553 consensus_queue.cc:260] T 013985779fe948f5b8a226502497aa2f P f05528ac015e4f0cb0aa748afdc2c12e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.257723 10553 ts_tablet_manager.cc:1428] T 013985779fe948f5b8a226502497aa2f P f05528ac015e4f0cb0aa748afdc2c12e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 12:03:37.258000 10553 tablet_bootstrap.cc:492] T 2e7c9b8049094f84ab877baba38947c8 P f05528ac015e4f0cb0aa748afdc2c12e: Bootstrap starting.
I20260809 12:03:37.259635 10553 tablet_bootstrap.cc:654] T 2e7c9b8049094f84ab877baba38947c8 P f05528ac015e4f0cb0aa748afdc2c12e: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:37.263859 10536 tablet_bootstrap.cc:492] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796: No bootstrap required, opened a new log
I20260809 12:03:37.264027 10536 ts_tablet_manager.cc:1397] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.002s
I20260809 12:03:37.264887 10536 raft_consensus.cc:348] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.265185 10536 raft_consensus.cc:374] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:37.265278 10536 raft_consensus.cc:729] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cde39fbb4ced4d049fef6754c3f3e796, State: Initialized, Role: FOLLOWER
I20260809 12:03:37.265547 10536 consensus_queue.cc:260] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.266211 10536 ts_tablet_manager.cc:1428] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260809 12:03:37.266542 10536 tablet_bootstrap.cc:492] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796: Bootstrap starting.
I20260809 12:03:37.271574 10536 tablet_bootstrap.cc:654] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:37.271957 10553 tablet_bootstrap.cc:492] T 2e7c9b8049094f84ab877baba38947c8 P f05528ac015e4f0cb0aa748afdc2c12e: No bootstrap required, opened a new log
I20260809 12:03:37.272106 10553 ts_tablet_manager.cc:1397] T 2e7c9b8049094f84ab877baba38947c8 P f05528ac015e4f0cb0aa748afdc2c12e: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.002s
I20260809 12:03:37.272786 10553 raft_consensus.cc:348] T 2e7c9b8049094f84ab877baba38947c8 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.273046 10553 raft_consensus.cc:374] T 2e7c9b8049094f84ab877baba38947c8 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:37.273132 10553 raft_consensus.cc:729] T 2e7c9b8049094f84ab877baba38947c8 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f05528ac015e4f0cb0aa748afdc2c12e, State: Initialized, Role: FOLLOWER
I20260809 12:03:37.273389 10553 consensus_queue.cc:260] T 2e7c9b8049094f84ab877baba38947c8 P f05528ac015e4f0cb0aa748afdc2c12e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.273612 10546 tablet_bootstrap.cc:492] T 2e7c9b8049094f84ab877baba38947c8 P e0b5e4c0505c4122ae1349ee4beb5bd1: No bootstrap required, opened a new log
I20260809 12:03:37.273821 10546 ts_tablet_manager.cc:1397] T 2e7c9b8049094f84ab877baba38947c8 P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent bootstrapping tablet: real 0.021s user 0.017s sys 0.002s
I20260809 12:03:37.274638 10546 raft_consensus.cc:348] T 2e7c9b8049094f84ab877baba38947c8 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.274922 10546 raft_consensus.cc:374] T 2e7c9b8049094f84ab877baba38947c8 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:37.275010 10546 raft_consensus.cc:729] T 2e7c9b8049094f84ab877baba38947c8 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0b5e4c0505c4122ae1349ee4beb5bd1, State: Initialized, Role: FOLLOWER
I20260809 12:03:37.275362 10553 ts_tablet_manager.cc:1428] T 2e7c9b8049094f84ab877baba38947c8 P f05528ac015e4f0cb0aa748afdc2c12e: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260809 12:03:37.275262 10546 consensus_queue.cc:260] T 2e7c9b8049094f84ab877baba38947c8 P e0b5e4c0505c4122ae1349ee4beb5bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.277194 10553 tablet_bootstrap.cc:492] T 3366ce108f824dc2a04e38b230c4ba88 P f05528ac015e4f0cb0aa748afdc2c12e: Bootstrap starting.
I20260809 12:03:37.277298 10536 tablet_bootstrap.cc:492] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796: No bootstrap required, opened a new log
I20260809 12:03:37.277462 10536 ts_tablet_manager.cc:1397] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.002s
I20260809 12:03:37.278209 10536 raft_consensus.cc:348] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.278457 10536 raft_consensus.cc:374] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:37.278535 10536 raft_consensus.cc:729] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cde39fbb4ced4d049fef6754c3f3e796, State: Initialized, Role: FOLLOWER
I20260809 12:03:37.278772 10536 consensus_queue.cc:260] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.281483 10536 ts_tablet_manager.cc:1428] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260809 12:03:37.281829 10536 tablet_bootstrap.cc:492] T 3366ce108f824dc2a04e38b230c4ba88 P cde39fbb4ced4d049fef6754c3f3e796: Bootstrap starting.
I20260809 12:03:37.282291 10546 ts_tablet_manager.cc:1428] T 2e7c9b8049094f84ab877baba38947c8 P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260809 12:03:37.284227 10536 tablet_bootstrap.cc:654] T 3366ce108f824dc2a04e38b230c4ba88 P cde39fbb4ced4d049fef6754c3f3e796: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:37.284991 10546 tablet_bootstrap.cc:492] T ce8a862530c448fa9c6241462a998723 P e0b5e4c0505c4122ae1349ee4beb5bd1: Bootstrap starting.
I20260809 12:03:37.285408 10553 tablet_bootstrap.cc:654] T 3366ce108f824dc2a04e38b230c4ba88 P f05528ac015e4f0cb0aa748afdc2c12e: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:37.286989 10546 tablet_bootstrap.cc:654] T ce8a862530c448fa9c6241462a998723 P e0b5e4c0505c4122ae1349ee4beb5bd1: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:37.291863 10553 tablet_bootstrap.cc:492] T 3366ce108f824dc2a04e38b230c4ba88 P f05528ac015e4f0cb0aa748afdc2c12e: No bootstrap required, opened a new log
I20260809 12:03:37.292033 10553 ts_tablet_manager.cc:1397] T 3366ce108f824dc2a04e38b230c4ba88 P f05528ac015e4f0cb0aa748afdc2c12e: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260809 12:03:37.292750 10553 raft_consensus.cc:348] T 3366ce108f824dc2a04e38b230c4ba88 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.292989 10553 raft_consensus.cc:374] T 3366ce108f824dc2a04e38b230c4ba88 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:37.293063 10553 raft_consensus.cc:729] T 3366ce108f824dc2a04e38b230c4ba88 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f05528ac015e4f0cb0aa748afdc2c12e, State: Initialized, Role: FOLLOWER
I20260809 12:03:37.293308 10553 consensus_queue.cc:260] T 3366ce108f824dc2a04e38b230c4ba88 P f05528ac015e4f0cb0aa748afdc2c12e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.295306 10553 ts_tablet_manager.cc:1428] T 3366ce108f824dc2a04e38b230c4ba88 P f05528ac015e4f0cb0aa748afdc2c12e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260809 12:03:37.296767 10553 tablet_bootstrap.cc:492] T d8214eed04f14bd5bbe3a79b549fa71c P f05528ac015e4f0cb0aa748afdc2c12e: Bootstrap starting.
I20260809 12:03:37.298949 10553 tablet_bootstrap.cc:654] T d8214eed04f14bd5bbe3a79b549fa71c P f05528ac015e4f0cb0aa748afdc2c12e: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:37.302291 10536 tablet_bootstrap.cc:492] T 3366ce108f824dc2a04e38b230c4ba88 P cde39fbb4ced4d049fef6754c3f3e796: No bootstrap required, opened a new log
I20260809 12:03:37.302387 10553 tablet_bootstrap.cc:492] T d8214eed04f14bd5bbe3a79b549fa71c P f05528ac015e4f0cb0aa748afdc2c12e: No bootstrap required, opened a new log
I20260809 12:03:37.302459 10536 ts_tablet_manager.cc:1397] T 3366ce108f824dc2a04e38b230c4ba88 P cde39fbb4ced4d049fef6754c3f3e796: Time spent bootstrapping tablet: real 0.021s user 0.008s sys 0.011s
I20260809 12:03:37.302529 10553 ts_tablet_manager.cc:1397] T d8214eed04f14bd5bbe3a79b549fa71c P f05528ac015e4f0cb0aa748afdc2c12e: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20260809 12:03:37.303134 10553 raft_consensus.cc:348] T d8214eed04f14bd5bbe3a79b549fa71c P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.303349 10553 raft_consensus.cc:374] T d8214eed04f14bd5bbe3a79b549fa71c P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:37.303217 10536 raft_consensus.cc:348] T 3366ce108f824dc2a04e38b230c4ba88 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.303455 10553 raft_consensus.cc:729] T d8214eed04f14bd5bbe3a79b549fa71c P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f05528ac015e4f0cb0aa748afdc2c12e, State: Initialized, Role: FOLLOWER
I20260809 12:03:37.303473 10536 raft_consensus.cc:374] T 3366ce108f824dc2a04e38b230c4ba88 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:37.303570 10536 raft_consensus.cc:729] T 3366ce108f824dc2a04e38b230c4ba88 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cde39fbb4ced4d049fef6754c3f3e796, State: Initialized, Role: FOLLOWER
I20260809 12:03:37.303686 10553 consensus_queue.cc:260] T d8214eed04f14bd5bbe3a79b549fa71c P f05528ac015e4f0cb0aa748afdc2c12e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.303787 10536 consensus_queue.cc:260] T 3366ce108f824dc2a04e38b230c4ba88 P cde39fbb4ced4d049fef6754c3f3e796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.306452 10553 ts_tablet_manager.cc:1428] T d8214eed04f14bd5bbe3a79b549fa71c P f05528ac015e4f0cb0aa748afdc2c12e: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260809 12:03:37.307143 10536 ts_tablet_manager.cc:1428] T 3366ce108f824dc2a04e38b230c4ba88 P cde39fbb4ced4d049fef6754c3f3e796: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260809 12:03:37.307502 10553 tablet_bootstrap.cc:492] T f2b1d869fa714372bb2bdce7e9bcdfa8 P f05528ac015e4f0cb0aa748afdc2c12e: Bootstrap starting.
I20260809 12:03:37.309230 10546 tablet_bootstrap.cc:492] T ce8a862530c448fa9c6241462a998723 P e0b5e4c0505c4122ae1349ee4beb5bd1: No bootstrap required, opened a new log
I20260809 12:03:37.309410 10546 ts_tablet_manager.cc:1397] T ce8a862530c448fa9c6241462a998723 P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent bootstrapping tablet: real 0.025s user 0.013s sys 0.001s
I20260809 12:03:37.310217 10546 raft_consensus.cc:348] T ce8a862530c448fa9c6241462a998723 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.310567 10546 raft_consensus.cc:374] T ce8a862530c448fa9c6241462a998723 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:37.310693 10546 raft_consensus.cc:729] T ce8a862530c448fa9c6241462a998723 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0b5e4c0505c4122ae1349ee4beb5bd1, State: Initialized, Role: FOLLOWER
I20260809 12:03:37.310948 10546 consensus_queue.cc:260] T ce8a862530c448fa9c6241462a998723 P e0b5e4c0505c4122ae1349ee4beb5bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.311350 10536 tablet_bootstrap.cc:492] T 013985779fe948f5b8a226502497aa2f P cde39fbb4ced4d049fef6754c3f3e796: Bootstrap starting.
I20260809 12:03:37.312157 10553 tablet_bootstrap.cc:654] T f2b1d869fa714372bb2bdce7e9bcdfa8 P f05528ac015e4f0cb0aa748afdc2c12e: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:37.313103 10536 tablet_bootstrap.cc:654] T 013985779fe948f5b8a226502497aa2f P cde39fbb4ced4d049fef6754c3f3e796: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:37.315049 10546 ts_tablet_manager.cc:1428] T ce8a862530c448fa9c6241462a998723 P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20260809 12:03:37.316329 10546 tablet_bootstrap.cc:492] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1: Bootstrap starting.
I20260809 12:03:37.318056 10546 tablet_bootstrap.cc:654] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:37.319777 10553 tablet_bootstrap.cc:492] T f2b1d869fa714372bb2bdce7e9bcdfa8 P f05528ac015e4f0cb0aa748afdc2c12e: No bootstrap required, opened a new log
I20260809 12:03:37.320045 10553 ts_tablet_manager.cc:1397] T f2b1d869fa714372bb2bdce7e9bcdfa8 P f05528ac015e4f0cb0aa748afdc2c12e: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.002s
I20260809 12:03:37.321074 10536 tablet_bootstrap.cc:492] T 013985779fe948f5b8a226502497aa2f P cde39fbb4ced4d049fef6754c3f3e796: No bootstrap required, opened a new log
I20260809 12:03:37.320969 10553 raft_consensus.cc:348] T f2b1d869fa714372bb2bdce7e9bcdfa8 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.321246 10536 ts_tablet_manager.cc:1397] T 013985779fe948f5b8a226502497aa2f P cde39fbb4ced4d049fef6754c3f3e796: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.006s
I20260809 12:03:37.321408 10553 raft_consensus.cc:374] T f2b1d869fa714372bb2bdce7e9bcdfa8 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:37.321545 10553 raft_consensus.cc:729] T f2b1d869fa714372bb2bdce7e9bcdfa8 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f05528ac015e4f0cb0aa748afdc2c12e, State: Initialized, Role: FOLLOWER
I20260809 12:03:37.321921 10536 raft_consensus.cc:348] T 013985779fe948f5b8a226502497aa2f P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.322183 10536 raft_consensus.cc:374] T 013985779fe948f5b8a226502497aa2f P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:37.321970 10553 consensus_queue.cc:260] T f2b1d869fa714372bb2bdce7e9bcdfa8 P f05528ac015e4f0cb0aa748afdc2c12e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.322263 10536 raft_consensus.cc:729] T 013985779fe948f5b8a226502497aa2f P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cde39fbb4ced4d049fef6754c3f3e796, State: Initialized, Role: FOLLOWER
I20260809 12:03:37.322499 10536 consensus_queue.cc:260] T 013985779fe948f5b8a226502497aa2f P cde39fbb4ced4d049fef6754c3f3e796 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.324888 10553 ts_tablet_manager.cc:1428] T f2b1d869fa714372bb2bdce7e9bcdfa8 P f05528ac015e4f0cb0aa748afdc2c12e: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260809 12:03:37.326156 10536 ts_tablet_manager.cc:1428] T 013985779fe948f5b8a226502497aa2f P cde39fbb4ced4d049fef6754c3f3e796: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260809 12:03:37.332392 10546 tablet_bootstrap.cc:492] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1: No bootstrap required, opened a new log
I20260809 12:03:37.332580 10546 ts_tablet_manager.cc:1397] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.004s
I20260809 12:03:37.332964 10554 raft_consensus.cc:482] T f2b1d869fa714372bb2bdce7e9bcdfa8 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:37.333141 10554 raft_consensus.cc:504] T f2b1d869fa714372bb2bdce7e9bcdfa8 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.333472 10546 raft_consensus.cc:348] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.333732 10546 raft_consensus.cc:374] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:37.333830 10546 raft_consensus.cc:729] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0b5e4c0505c4122ae1349ee4beb5bd1, State: Initialized, Role: FOLLOWER
I20260809 12:03:37.333935 10554 leader_election.cc:288] T f2b1d869fa714372bb2bdce7e9bcdfa8 P cde39fbb4ced4d049fef6754c3f3e796 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723), e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:37.334118 10546 consensus_queue.cc:260] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.335060 9226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2b1d869fa714372bb2bdce7e9bcdfa8" candidate_uuid: "cde39fbb4ced4d049fef6754c3f3e796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" is_pre_election: true
I20260809 12:03:37.335232 9680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2b1d869fa714372bb2bdce7e9bcdfa8" candidate_uuid: "cde39fbb4ced4d049fef6754c3f3e796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" is_pre_election: true
I20260809 12:03:37.335366 9226 raft_consensus.cc:2454] T f2b1d869fa714372bb2bdce7e9bcdfa8 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cde39fbb4ced4d049fef6754c3f3e796 in term 0.
I20260809 12:03:37.336131 10546 ts_tablet_manager.cc:1428] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260809 12:03:37.336169 9351 leader_election.cc:341] T f2b1d869fa714372bb2bdce7e9bcdfa8 P cde39fbb4ced4d049fef6754c3f3e796 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793): Illegal state: must be running to vote when last-logged opid is not known
I20260809 12:03:37.336709 9347 leader_election.cc:302] T f2b1d869fa714372bb2bdce7e9bcdfa8 P cde39fbb4ced4d049fef6754c3f3e796 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e; no voters: e0b5e4c0505c4122ae1349ee4beb5bd1
I20260809 12:03:37.337387 10546 tablet_bootstrap.cc:492] T f2b1d869fa714372bb2bdce7e9bcdfa8 P e0b5e4c0505c4122ae1349ee4beb5bd1: Bootstrap starting.
I20260809 12:03:37.338419 10554 raft_consensus.cc:2781] T f2b1d869fa714372bb2bdce7e9bcdfa8 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 12:03:37.338550 10554 raft_consensus.cc:482] T f2b1d869fa714372bb2bdce7e9bcdfa8 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 12:03:37.338649 10554 raft_consensus.cc:3037] T f2b1d869fa714372bb2bdce7e9bcdfa8 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:37.341114 10546 tablet_bootstrap.cc:654] T f2b1d869fa714372bb2bdce7e9bcdfa8 P e0b5e4c0505c4122ae1349ee4beb5bd1: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:37.341696 10554 raft_consensus.cc:504] T f2b1d869fa714372bb2bdce7e9bcdfa8 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.342504 10554 leader_election.cc:288] T f2b1d869fa714372bb2bdce7e9bcdfa8 P cde39fbb4ced4d049fef6754c3f3e796 [CANDIDATE]: Term 1 election: Requested vote from peers f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723), e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:37.343071 9680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2b1d869fa714372bb2bdce7e9bcdfa8" candidate_uuid: "cde39fbb4ced4d049fef6754c3f3e796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1"
I20260809 12:03:37.343349 9226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2b1d869fa714372bb2bdce7e9bcdfa8" candidate_uuid: "cde39fbb4ced4d049fef6754c3f3e796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f05528ac015e4f0cb0aa748afdc2c12e"
I20260809 12:03:37.343587 9226 raft_consensus.cc:3037] T f2b1d869fa714372bb2bdce7e9bcdfa8 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Advancing to term 1
W20260809 12:03:37.343762 9351 leader_election.cc:341] T f2b1d869fa714372bb2bdce7e9bcdfa8 P cde39fbb4ced4d049fef6754c3f3e796 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793): Illegal state: must be running to vote when last-logged opid is not known
I20260809 12:03:37.344563 10546 tablet_bootstrap.cc:492] T f2b1d869fa714372bb2bdce7e9bcdfa8 P e0b5e4c0505c4122ae1349ee4beb5bd1: No bootstrap required, opened a new log
I20260809 12:03:37.344714 10546 ts_tablet_manager.cc:1397] T f2b1d869fa714372bb2bdce7e9bcdfa8 P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.003s
I20260809 12:03:37.345356 10546 raft_consensus.cc:348] T f2b1d869fa714372bb2bdce7e9bcdfa8 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.345547 10546 raft_consensus.cc:374] T f2b1d869fa714372bb2bdce7e9bcdfa8 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:37.345651 10546 raft_consensus.cc:729] T f2b1d869fa714372bb2bdce7e9bcdfa8 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0b5e4c0505c4122ae1349ee4beb5bd1, State: Initialized, Role: FOLLOWER
I20260809 12:03:37.345885 10546 consensus_queue.cc:260] T f2b1d869fa714372bb2bdce7e9bcdfa8 P e0b5e4c0505c4122ae1349ee4beb5bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.346506 9226 raft_consensus.cc:2454] T f2b1d869fa714372bb2bdce7e9bcdfa8 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cde39fbb4ced4d049fef6754c3f3e796 in term 1.
I20260809 12:03:37.347080 9347 leader_election.cc:302] T f2b1d869fa714372bb2bdce7e9bcdfa8 P cde39fbb4ced4d049fef6754c3f3e796 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e; no voters: e0b5e4c0505c4122ae1349ee4beb5bd1
I20260809 12:03:37.347486 10554 raft_consensus.cc:2781] T f2b1d869fa714372bb2bdce7e9bcdfa8 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 12:03:37.347586 10546 ts_tablet_manager.cc:1428] T f2b1d869fa714372bb2bdce7e9bcdfa8 P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260809 12:03:37.348093 10546 tablet_bootstrap.cc:492] T d8214eed04f14bd5bbe3a79b549fa71c P e0b5e4c0505c4122ae1349ee4beb5bd1: Bootstrap starting.
I20260809 12:03:37.350076 10546 tablet_bootstrap.cc:654] T d8214eed04f14bd5bbe3a79b549fa71c P e0b5e4c0505c4122ae1349ee4beb5bd1: Neither blocks nor log segments found. Creating new log.
I20260809 12:03:37.350112 10554 raft_consensus.cc:686] T f2b1d869fa714372bb2bdce7e9bcdfa8 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 LEADER]: Becoming Leader. State: Replica: cde39fbb4ced4d049fef6754c3f3e796, State: Running, Role: LEADER
I20260809 12:03:37.350548 10554 consensus_queue.cc:237] T f2b1d869fa714372bb2bdce7e9bcdfa8 P cde39fbb4ced4d049fef6754c3f3e796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.355062 10546 tablet_bootstrap.cc:492] T d8214eed04f14bd5bbe3a79b549fa71c P e0b5e4c0505c4122ae1349ee4beb5bd1: No bootstrap required, opened a new log
I20260809 12:03:37.355242 10546 ts_tablet_manager.cc:1397] T d8214eed04f14bd5bbe3a79b549fa71c P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.004s
I20260809 12:03:37.356096 10546 raft_consensus.cc:348] T d8214eed04f14bd5bbe3a79b549fa71c P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.356393 10546 raft_consensus.cc:374] T d8214eed04f14bd5bbe3a79b549fa71c P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 12:03:37.356479 10546 raft_consensus.cc:729] T d8214eed04f14bd5bbe3a79b549fa71c P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0b5e4c0505c4122ae1349ee4beb5bd1, State: Initialized, Role: FOLLOWER
I20260809 12:03:37.356770 10546 consensus_queue.cc:260] T d8214eed04f14bd5bbe3a79b549fa71c P e0b5e4c0505c4122ae1349ee4beb5bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.359577 10546 ts_tablet_manager.cc:1428] T d8214eed04f14bd5bbe3a79b549fa71c P e0b5e4c0505c4122ae1349ee4beb5bd1: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260809 12:03:37.414849 10554 raft_consensus.cc:482] T d8214eed04f14bd5bbe3a79b549fa71c P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:37.415151 10554 raft_consensus.cc:504] T d8214eed04f14bd5bbe3a79b549fa71c P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.415971 10554 leader_election.cc:288] T d8214eed04f14bd5bbe3a79b549fa71c P cde39fbb4ced4d049fef6754c3f3e796 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723), e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:37.416675 9680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8214eed04f14bd5bbe3a79b549fa71c" candidate_uuid: "cde39fbb4ced4d049fef6754c3f3e796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" is_pre_election: true
I20260809 12:03:37.416973 9680 raft_consensus.cc:2454] T d8214eed04f14bd5bbe3a79b549fa71c P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cde39fbb4ced4d049fef6754c3f3e796 in term 0.
I20260809 12:03:37.417409 9351 leader_election.cc:302] T d8214eed04f14bd5bbe3a79b549fa71c P cde39fbb4ced4d049fef6754c3f3e796 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cde39fbb4ced4d049fef6754c3f3e796, e0b5e4c0505c4122ae1349ee4beb5bd1; no voters:
I20260809 12:03:37.417412 9226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8214eed04f14bd5bbe3a79b549fa71c" candidate_uuid: "cde39fbb4ced4d049fef6754c3f3e796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" is_pre_election: true
I20260809 12:03:37.417698 9226 raft_consensus.cc:2454] T d8214eed04f14bd5bbe3a79b549fa71c P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cde39fbb4ced4d049fef6754c3f3e796 in term 0.
I20260809 12:03:37.418066 10554 raft_consensus.cc:2781] T d8214eed04f14bd5bbe3a79b549fa71c P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 12:03:37.418177 10554 raft_consensus.cc:482] T d8214eed04f14bd5bbe3a79b549fa71c P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 12:03:37.418282 10554 raft_consensus.cc:3037] T d8214eed04f14bd5bbe3a79b549fa71c P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:37.421161 10597 raft_consensus.cc:482] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:37.421185 10554 raft_consensus.cc:504] T d8214eed04f14bd5bbe3a79b549fa71c P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.421327 10597 raft_consensus.cc:504] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.422019 10554 leader_election.cc:288] T d8214eed04f14bd5bbe3a79b549fa71c P cde39fbb4ced4d049fef6754c3f3e796 [CANDIDATE]: Term 1 election: Requested vote from peers f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723), e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:37.422374 9226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8214eed04f14bd5bbe3a79b549fa71c" candidate_uuid: "cde39fbb4ced4d049fef6754c3f3e796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f05528ac015e4f0cb0aa748afdc2c12e"
I20260809 12:03:37.422605 9226 raft_consensus.cc:3037] T d8214eed04f14bd5bbe3a79b549fa71c P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:37.422555 9465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "013985779fe948f5b8a226502497aa2f" candidate_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde39fbb4ced4d049fef6754c3f3e796" is_pre_election: true
I20260809 12:03:37.422746 9465 raft_consensus.cc:2454] T 013985779fe948f5b8a226502497aa2f P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0b5e4c0505c4122ae1349ee4beb5bd1 in term 0.
I20260809 12:03:37.422959 10597 leader_election.cc:288] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
I20260809 12:03:37.423182 9573 leader_election.cc:302] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cde39fbb4ced4d049fef6754c3f3e796, e0b5e4c0505c4122ae1349ee4beb5bd1; no voters:
I20260809 12:03:37.423485 10597 raft_consensus.cc:2781] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 12:03:37.423486 9680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8214eed04f14bd5bbe3a79b549fa71c" candidate_uuid: "cde39fbb4ced4d049fef6754c3f3e796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1"
I20260809 12:03:37.423620 10597 raft_consensus.cc:482] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 12:03:37.423703 10597 raft_consensus.cc:3037] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:37.423733 9680 raft_consensus.cc:3037] T d8214eed04f14bd5bbe3a79b549fa71c P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:37.425460 9226 raft_consensus.cc:2454] T d8214eed04f14bd5bbe3a79b549fa71c P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cde39fbb4ced4d049fef6754c3f3e796 in term 1.
I20260809 12:03:37.426158 9347 leader_election.cc:302] T d8214eed04f14bd5bbe3a79b549fa71c P cde39fbb4ced4d049fef6754c3f3e796 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e; no voters:
I20260809 12:03:37.426555 9226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "013985779fe948f5b8a226502497aa2f" candidate_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" is_pre_election: true
I20260809 12:03:37.426780 9226 raft_consensus.cc:2454] T 013985779fe948f5b8a226502497aa2f P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0b5e4c0505c4122ae1349ee4beb5bd1 in term 0.
I20260809 12:03:37.426849 9680 raft_consensus.cc:2454] T d8214eed04f14bd5bbe3a79b549fa71c P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cde39fbb4ced4d049fef6754c3f3e796 in term 1.
I20260809 12:03:37.426949 10597 raft_consensus.cc:504] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.427476 10554 raft_consensus.cc:2781] T d8214eed04f14bd5bbe3a79b549fa71c P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 12:03:37.427661 10554 raft_consensus.cc:686] T d8214eed04f14bd5bbe3a79b549fa71c P cde39fbb4ced4d049fef6754c3f3e796 [term 1 LEADER]: Becoming Leader. State: Replica: cde39fbb4ced4d049fef6754c3f3e796, State: Running, Role: LEADER
I20260809 12:03:37.428151 9465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "013985779fe948f5b8a226502497aa2f" candidate_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde39fbb4ced4d049fef6754c3f3e796"
I20260809 12:03:37.428197 10554 consensus_queue.cc:237] T d8214eed04f14bd5bbe3a79b549fa71c P cde39fbb4ced4d049fef6754c3f3e796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.428399 9465 raft_consensus.cc:3037] T 013985779fe948f5b8a226502497aa2f P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:37.429682 10597 leader_election.cc:288] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 1 election: Requested vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
I20260809 12:03:37.429775 9226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "013985779fe948f5b8a226502497aa2f" candidate_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f05528ac015e4f0cb0aa748afdc2c12e"
I20260809 12:03:37.429986 9226 raft_consensus.cc:3037] T 013985779fe948f5b8a226502497aa2f P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:37.430997 9465 raft_consensus.cc:2454] T 013985779fe948f5b8a226502497aa2f P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0b5e4c0505c4122ae1349ee4beb5bd1 in term 1.
I20260809 12:03:37.431474 9573 leader_election.cc:302] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cde39fbb4ced4d049fef6754c3f3e796, e0b5e4c0505c4122ae1349ee4beb5bd1; no voters:
I20260809 12:03:37.431741 10597 raft_consensus.cc:2781] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 12:03:37.431880 10597 raft_consensus.cc:686] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 LEADER]: Becoming Leader. State: Replica: e0b5e4c0505c4122ae1349ee4beb5bd1, State: Running, Role: LEADER
I20260809 12:03:37.432150 10597 consensus_queue.cc:237] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.433380 9226 raft_consensus.cc:2454] T 013985779fe948f5b8a226502497aa2f P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0b5e4c0505c4122ae1349ee4beb5bd1 in term 1.
I20260809 12:03:37.452744 10554 raft_consensus.cc:482] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:37.452941 10554 raft_consensus.cc:504] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.453656 10554 leader_election.cc:288] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723), e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:37.454275 9226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e7c9b8049094f84ab877baba38947c8" candidate_uuid: "cde39fbb4ced4d049fef6754c3f3e796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" is_pre_election: true
I20260809 12:03:37.454285 9680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e7c9b8049094f84ab877baba38947c8" candidate_uuid: "cde39fbb4ced4d049fef6754c3f3e796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" is_pre_election: true
I20260809 12:03:37.454526 9226 raft_consensus.cc:2454] T 2e7c9b8049094f84ab877baba38947c8 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cde39fbb4ced4d049fef6754c3f3e796 in term 0.
I20260809 12:03:37.454622 9680 raft_consensus.cc:2454] T 2e7c9b8049094f84ab877baba38947c8 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cde39fbb4ced4d049fef6754c3f3e796 in term 0.
I20260809 12:03:37.455019 9347 leader_election.cc:302] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e; no voters:
I20260809 12:03:37.455322 10554 raft_consensus.cc:2781] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 12:03:37.455452 10554 raft_consensus.cc:482] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 12:03:37.455551 10554 raft_consensus.cc:3037] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:37.457463 10554 raft_consensus.cc:504] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.457999 10554 leader_election.cc:288] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796 [CANDIDATE]: Term 1 election: Requested vote from peers f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723), e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:37.458484 9680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e7c9b8049094f84ab877baba38947c8" candidate_uuid: "cde39fbb4ced4d049fef6754c3f3e796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1"
I20260809 12:03:37.458505 9226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e7c9b8049094f84ab877baba38947c8" candidate_uuid: "cde39fbb4ced4d049fef6754c3f3e796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f05528ac015e4f0cb0aa748afdc2c12e"
I20260809 12:03:37.458681 9680 raft_consensus.cc:3037] T 2e7c9b8049094f84ab877baba38947c8 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:37.458712 9226 raft_consensus.cc:3037] T 2e7c9b8049094f84ab877baba38947c8 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:37.460660 9680 raft_consensus.cc:2454] T 2e7c9b8049094f84ab877baba38947c8 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cde39fbb4ced4d049fef6754c3f3e796 in term 1.
I20260809 12:03:37.461041 9351 leader_election.cc:302] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cde39fbb4ced4d049fef6754c3f3e796, e0b5e4c0505c4122ae1349ee4beb5bd1; no voters:
I20260809 12:03:37.461311 10554 raft_consensus.cc:2781] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 12:03:37.461603 9226 raft_consensus.cc:2454] T 2e7c9b8049094f84ab877baba38947c8 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cde39fbb4ced4d049fef6754c3f3e796 in term 1.
I20260809 12:03:37.461475 10554 raft_consensus.cc:686] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 LEADER]: Becoming Leader. State: Replica: cde39fbb4ced4d049fef6754c3f3e796, State: Running, Role: LEADER
I20260809 12:03:37.462488 10554 consensus_queue.cc:237] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
W20260809 12:03:37.464831 9571 connection.cc:535] server connection from 127.0.0.1:56438 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:37.464866 9347 connection.cc:535] server connection from 127.0.0.1:44236 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:37.465075 9347 connection.cc:535] client connection to 127.8.15.125:37165 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:37.465101 9127 connection.cc:535] server connection from 127.0.0.1:41256 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:37.466192 9123 connection.cc:535] client connection to 127.8.15.125:37165 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:37.466536 9779 connection.cc:535] client connection to 127.8.15.125:37165 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:37.466744 10516 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 12:03:37.465750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.15.125:37165 (local address 127.8.15.66:47225)
0809 12:03:37.465933 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 12:03:37.465955 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 12:03:37.466075 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 12:03:37.466426 (+ 351us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":57}
W20260809 12:03:37.467145 9571 connection.cc:535] client connection to 127.8.15.125:37165 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:37.467254 9779 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.8.15.125:37165)
W20260809 12:03:37.467854 9779 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.8.15.125:37165)
W20260809 12:03:37.468082 9779 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.8.15.125:37165)
W20260809 12:03:37.468916 9779 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.8.15.125:37165)
I20260809 12:03:37.531620 10554 raft_consensus.cc:482] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:37.531813 10554 raft_consensus.cc:504] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.532353 10554 leader_election.cc:288] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723), e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:37.532823 9226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce8a862530c448fa9c6241462a998723" candidate_uuid: "cde39fbb4ced4d049fef6754c3f3e796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" is_pre_election: true
I20260809 12:03:37.532852 9680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce8a862530c448fa9c6241462a998723" candidate_uuid: "cde39fbb4ced4d049fef6754c3f3e796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" is_pre_election: true
I20260809 12:03:37.533089 9680 raft_consensus.cc:2454] T ce8a862530c448fa9c6241462a998723 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cde39fbb4ced4d049fef6754c3f3e796 in term 0.
I20260809 12:03:37.533105 9226 raft_consensus.cc:2454] T ce8a862530c448fa9c6241462a998723 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cde39fbb4ced4d049fef6754c3f3e796 in term 0.
I20260809 12:03:37.533484 9351 leader_election.cc:302] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cde39fbb4ced4d049fef6754c3f3e796, e0b5e4c0505c4122ae1349ee4beb5bd1; no voters:
I20260809 12:03:37.533751 10554 raft_consensus.cc:2781] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 12:03:37.533854 10554 raft_consensus.cc:482] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 12:03:37.533974 10554 raft_consensus.cc:3037] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:37.535866 10554 raft_consensus.cc:504] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.536386 10554 leader_election.cc:288] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796 [CANDIDATE]: Term 1 election: Requested vote from peers f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723), e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:37.536731 9226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce8a862530c448fa9c6241462a998723" candidate_uuid: "cde39fbb4ced4d049fef6754c3f3e796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f05528ac015e4f0cb0aa748afdc2c12e"
I20260809 12:03:37.536809 9680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce8a862530c448fa9c6241462a998723" candidate_uuid: "cde39fbb4ced4d049fef6754c3f3e796" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1"
I20260809 12:03:37.536914 9226 raft_consensus.cc:3037] T ce8a862530c448fa9c6241462a998723 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:37.537027 9680 raft_consensus.cc:3037] T ce8a862530c448fa9c6241462a998723 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:37.538753 9226 raft_consensus.cc:2454] T ce8a862530c448fa9c6241462a998723 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cde39fbb4ced4d049fef6754c3f3e796 in term 1.
I20260809 12:03:37.538865 9680 raft_consensus.cc:2454] T ce8a862530c448fa9c6241462a998723 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cde39fbb4ced4d049fef6754c3f3e796 in term 1.
I20260809 12:03:37.539119 9347 leader_election.cc:302] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e; no voters:
I20260809 12:03:37.539443 10554 raft_consensus.cc:2781] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 12:03:37.539615 10554 raft_consensus.cc:686] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 LEADER]: Becoming Leader. State: Replica: cde39fbb4ced4d049fef6754c3f3e796, State: Running, Role: LEADER
I20260809 12:03:37.540040 10554 consensus_queue.cc:237] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.653702 10624 raft_consensus.cc:482] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 061d8c3603f14343920d858e640b9dfd)
I20260809 12:03:37.653891 10624 raft_consensus.cc:504] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:37.654627 10624 leader_election.cc:288] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:03:37.656770 10052 leader_election.cc:334] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
W20260809 12:03:37.657012 10055 leader_election.cc:334] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:03:37.657143 10055 leader_election.cc:302] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abee08c3147547cc8f3379b5fc437835; no voters: 061d8c3603f14343920d858e640b9dfd, 1e38ce37027547efa06785b9247f59bc
I20260809 12:03:37.657367 10624 raft_consensus.cc:2726] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260809 12:03:37.765532 9960 master_runner.cc:186] Error getting master registration for 127.8.15.125:37165: Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111),
I20260809 12:03:37.765692 9960 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:03:37.818450 10597 raft_consensus.cc:482] T f2b1d869fa714372bb2bdce7e9bcdfa8 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:37.818686 10597 raft_consensus.cc:504] T f2b1d869fa714372bb2bdce7e9bcdfa8 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.819262 10597 leader_election.cc:288] T f2b1d869fa714372bb2bdce7e9bcdfa8 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
I20260809 12:03:37.819980 9226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2b1d869fa714372bb2bdce7e9bcdfa8" candidate_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" is_pre_election: true
I20260809 12:03:37.819962 9465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2b1d869fa714372bb2bdce7e9bcdfa8" candidate_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde39fbb4ced4d049fef6754c3f3e796" is_pre_election: true
I20260809 12:03:37.820408 9226 raft_consensus.cc:2379] T f2b1d869fa714372bb2bdce7e9bcdfa8 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e0b5e4c0505c4122ae1349ee4beb5bd1 in current term 1: Already voted for candidate cde39fbb4ced4d049fef6754c3f3e796 in this term.
I20260809 12:03:37.820868 9571 leader_election.cc:302] T f2b1d869fa714372bb2bdce7e9bcdfa8 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:03:37.821170 10597 raft_consensus.cc:3037] T f2b1d869fa714372bb2bdce7e9bcdfa8 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:37.823073 10597 raft_consensus.cc:2726] T f2b1d869fa714372bb2bdce7e9bcdfa8 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260809 12:03:37.871830 10597 raft_consensus.cc:482] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:37.872041 10597 raft_consensus.cc:504] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.872704 10597 leader_election.cc:288] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
I20260809 12:03:37.873239 9465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3366ce108f824dc2a04e38b230c4ba88" candidate_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde39fbb4ced4d049fef6754c3f3e796" is_pre_election: true
I20260809 12:03:37.873282 9226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3366ce108f824dc2a04e38b230c4ba88" candidate_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" is_pre_election: true
I20260809 12:03:37.873490 9465 raft_consensus.cc:2454] T 3366ce108f824dc2a04e38b230c4ba88 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0b5e4c0505c4122ae1349ee4beb5bd1 in term 0.
I20260809 12:03:37.873596 9226 raft_consensus.cc:2454] T 3366ce108f824dc2a04e38b230c4ba88 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0b5e4c0505c4122ae1349ee4beb5bd1 in term 0.
I20260809 12:03:37.873934 9573 leader_election.cc:302] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cde39fbb4ced4d049fef6754c3f3e796, e0b5e4c0505c4122ae1349ee4beb5bd1; no voters:
I20260809 12:03:37.874220 10597 raft_consensus.cc:2781] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 12:03:37.874351 10597 raft_consensus.cc:482] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 12:03:37.874424 10597 raft_consensus.cc:3037] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:37.876317 10597 raft_consensus.cc:504] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:37.876778 10597 leader_election.cc:288] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 1 election: Requested vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
I20260809 12:03:37.877249 9465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3366ce108f824dc2a04e38b230c4ba88" candidate_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde39fbb4ced4d049fef6754c3f3e796"
I20260809 12:03:37.877269 9226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3366ce108f824dc2a04e38b230c4ba88" candidate_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f05528ac015e4f0cb0aa748afdc2c12e"
I20260809 12:03:37.877434 9226 raft_consensus.cc:3037] T 3366ce108f824dc2a04e38b230c4ba88 P f05528ac015e4f0cb0aa748afdc2c12e [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:37.877442 9465 raft_consensus.cc:3037] T 3366ce108f824dc2a04e38b230c4ba88 P cde39fbb4ced4d049fef6754c3f3e796 [term 0 FOLLOWER]: Advancing to term 1
I20260809 12:03:37.879220 9465 raft_consensus.cc:2454] T 3366ce108f824dc2a04e38b230c4ba88 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0b5e4c0505c4122ae1349ee4beb5bd1 in term 1.
I20260809 12:03:37.879228 9226 raft_consensus.cc:2454] T 3366ce108f824dc2a04e38b230c4ba88 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0b5e4c0505c4122ae1349ee4beb5bd1 in term 1.
I20260809 12:03:37.879614 9571 leader_election.cc:302] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1, f05528ac015e4f0cb0aa748afdc2c12e; no voters:
I20260809 12:03:37.879896 10597 raft_consensus.cc:2781] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 12:03:37.880031 10597 raft_consensus.cc:686] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 LEADER]: Becoming Leader. State: Replica: e0b5e4c0505c4122ae1349ee4beb5bd1, State: Running, Role: LEADER
I20260809 12:03:37.880326 10597 consensus_queue.cc:237] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:38.286146 10630 consensus_queue.cc:1035] T f2b1d869fa714372bb2bdce7e9bcdfa8 P cde39fbb4ced4d049fef6754c3f3e796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:38.292448 10633 consensus_queue.cc:1035] T f2b1d869fa714372bb2bdce7e9bcdfa8 P cde39fbb4ced4d049fef6754c3f3e796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:38.297837 10629 consensus_queue.cc:1035] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:38.303404 10629 consensus_queue.cc:1035] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:38.311414 10633 consensus_queue.cc:1035] T d8214eed04f14bd5bbe3a79b549fa71c P cde39fbb4ced4d049fef6754c3f3e796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:38.324015 10633 consensus_queue.cc:1035] T d8214eed04f14bd5bbe3a79b549fa71c P cde39fbb4ced4d049fef6754c3f3e796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:38.400745 10653 raft_consensus.cc:482] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 061d8c3603f14343920d858e640b9dfd)
I20260809 12:03:38.400985 10653 raft_consensus.cc:504] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:38.401670 10653 leader_election.cc:288] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:03:38.403839 10055 leader_election.cc:334] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
W20260809 12:03:38.404042 10052 leader_election.cc:334] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
I20260809 12:03:38.404170 10052 leader_election.cc:302] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abee08c3147547cc8f3379b5fc437835; no voters: 061d8c3603f14343920d858e640b9dfd, 1e38ce37027547efa06785b9247f59bc
I20260809 12:03:38.404381 10653 raft_consensus.cc:2726] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260809 12:03:38.432912 10649 consensus_queue.cc:1035] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:38.437685 10630 consensus_queue.cc:1035] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:38.499291 10630 consensus_queue.cc:1035] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:38.506314 10630 consensus_queue.cc:1035] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:38.745035 10629 consensus_queue.cc:1035] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:38.751178 10597 consensus_queue.cc:1035] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 12:03:38.908417 10671 raft_consensus.cc:482] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 061d8c3603f14343920d858e640b9dfd)
I20260809 12:03:38.908619 10671 raft_consensus.cc:504] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:38.909319 10671 leader_election.cc:288] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:03:38.910272 10055 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20260809 12:03:38.911439 10052 leader_election.cc:334] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
W20260809 12:03:38.911595 10055 leader_election.cc:334] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:03:38.911765 10055 leader_election.cc:302] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abee08c3147547cc8f3379b5fc437835; no voters: 061d8c3603f14343920d858e640b9dfd, 1e38ce37027547efa06785b9247f59bc
I20260809 12:03:38.912050 10671 raft_consensus.cc:2726] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260809 12:03:38.920953 8253 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
/tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.15.124:33307
--webserver_interface=127.8.15.124
--webserver_port=44863
--builtin_ntp_servers=127.8.15.84:46271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--hive_metastore_uris=thrift://127.0.0.1:44923
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260809 12:03:39.262145 10675 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 12:03:39.262411 10675 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 12:03:39.262493 10675 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 12:03:39.269538 10675 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 12:03:39.269636 10675 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 12:03:39.269687 10675 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 12:03:39.269768 10675 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 12:03:39.279692 10675 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.15.84:46271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:44923
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.15.124:33307
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.15.124
--webserver_port=44863
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:06:41 UTC on ccycloud.quasar-bwoogy.root.comops.site
build id 4575991
ASAN enabled
I20260809 12:03:39.281057 10675 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 12:03:39.282852 10675 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 12:03:39.294734 10695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:39.294800 10696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:39.295085 10699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 12:03:39.295830 10675 server_base.cc:1034] running on GCE node
I20260809 12:03:39.296584 10675 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 12:03:39.297967 10675 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 12:03:39.299189 10675 hybrid_clock.cc:648] HybridClock initialized: now 1786277019299128 us; error 41 us; skew 500 ppm
I20260809 12:03:39.299530 10675 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 12:03:39.301874 10675 webserver.cc:460] Webserver started at http://127.8.15.124:44863/ using document root <none> and password file <none>
I20260809 12:03:39.302541 10675 fs_manager.cc:359] Metadata directory not provided
I20260809 12:03:39.302672 10675 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 12:03:39.307735 10675 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 12:03:39.310652 10707 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 12:03:39.312255 10675 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 12:03:39.312448 10675 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data,/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/wal
uuid: "1e38ce37027547efa06785b9247f59bc"
format_stamp: "Formatted at 2026-08-09 12:03:27 on dist-test-slave-21b9"
I20260809 12:03:39.313740 10675 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 12:03:39.335949 10675 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 12:03:39.336796 10675 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 12:03:39.337054 10675 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 12:03:39.355731 10675 rpc_server.cc:307] RPC server started. Bound to: 127.8.15.124:33307
I20260809 12:03:39.355738 10796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.15.124:33307 every 8 connection(s)
I20260809 12:03:39.357245 10675 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data/info.pb
I20260809 12:03:39.361507 8253 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu as pid 10675
I20260809 12:03:39.364523 10797 sys_catalog.cc:263] Verifying existing consensus state
I20260809 12:03:39.369838 10797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: Bootstrap starting.
I20260809 12:03:39.381943 10797 log.cc:824] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: Log is configured to *not* fsync() on all Append() calls
I20260809 12:03:39.407768 10797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: Bootstrap replayed 1/1 log segments. Stats: ops{read=30 overwritten=0 applied=30 ignored=0} inserts{seen=24 ignored=0} mutations{seen=17 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 12:03:39.408352 10797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: Bootstrap complete.
I20260809 12:03:39.418229 10797 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:39.419724 10797 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e38ce37027547efa06785b9247f59bc, State: Initialized, Role: FOLLOWER
I20260809 12:03:39.420503 10797 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 30, Last appended: 2.30, Last appended by leader: 30, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:39.421623 10803 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:39.422019 10803 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:39.422859 10629 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:03:39.423013 10797 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 12:03:39.423036 10629 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:39.423734 10629 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:03:39.424790 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:03:39.425081 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:03:39.425200 9571 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:03:39.425595 10629 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 12:03:39.426231 9529 heartbeater.cc:347] Connected to a master server at 127.8.15.124:33307
I20260809 12:03:39.451458 10822 catalog_manager.cc:1259] Loaded cluster ID: a0f048c3ad03482e99d22bfc404ede58
I20260809 12:03:39.451591 10822 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: loading cluster ID for follower catalog manager: success
I20260809 12:03:39.455943 10822 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: acquiring CA information for follower catalog manager: success
I20260809 12:03:39.458958 10822 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 12:03:39.466034 10675 master_runner.cc:186] Error getting master registration for 127.8.15.125:37165: Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111),
I20260809 12:03:39.473737 10675 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:03:39.551699 9765 heartbeater.cc:347] Connected to a master server at 127.8.15.124:33307
I20260809 12:03:39.554994 10731 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" instance_seqno: 1786277010606266) as {username='slave'} at 127.8.15.67:51199; Asking this server to re-register.
I20260809 12:03:39.555721 9765 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:39.557435 10731 ts_manager.cc:194] Registered new tserver with Master: e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:39.727082 10832 raft_consensus.cc:482] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 061d8c3603f14343920d858e640b9dfd)
I20260809 12:03:39.727399 10832 raft_consensus.cc:504] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:39.728219 10832 leader_election.cc:288] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
I20260809 12:03:39.740437 10731 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" instance_seqno: 1786277009716171) as {username='slave'} at 127.8.15.66:52899; Asking this server to re-register.
I20260809 12:03:39.741319 9529 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:39.742959 10735 ts_manager.cc:194] Registered new tserver with Master: cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479)
W20260809 12:03:39.753182 10052 leader_election.cc:334] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
I20260809 12:03:39.759721 10748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "abee08c3147547cc8f3379b5fc437835" candidate_term: 5 candidate_status { last_received { term: 4 index: 44 } } ignore_live_leader: false dest_uuid: "1e38ce37027547efa06785b9247f59bc" is_pre_election: true
I20260809 12:03:39.761284 10748 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abee08c3147547cc8f3379b5fc437835 in term 2.
I20260809 12:03:39.762024 10055 leader_election.cc:302] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835; no voters: 061d8c3603f14343920d858e640b9dfd
I20260809 12:03:39.762432 10832 raft_consensus.cc:2781] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260809 12:03:39.762548 10832 raft_consensus.cc:482] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 061d8c3603f14343920d858e640b9dfd)
I20260809 12:03:39.762625 10832 raft_consensus.cc:3037] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 4 FOLLOWER]: Advancing to term 5
I20260809 12:03:39.765627 10832 raft_consensus.cc:504] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:39.766311 10832 leader_election.cc:288] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 5 election: Requested vote from peers 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
I20260809 12:03:39.767112 10748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "abee08c3147547cc8f3379b5fc437835" candidate_term: 5 candidate_status { last_received { term: 4 index: 44 } } ignore_live_leader: false dest_uuid: "1e38ce37027547efa06785b9247f59bc"
I20260809 12:03:39.767357 10748 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 2 FOLLOWER]: Advancing to term 5
W20260809 12:03:39.773808 10052 leader_election.cc:334] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
I20260809 12:03:39.774087 10748 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abee08c3147547cc8f3379b5fc437835 in term 5.
I20260809 12:03:39.774653 10055 leader_election.cc:302] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835; no voters: 061d8c3603f14343920d858e640b9dfd
I20260809 12:03:39.775501 10832 raft_consensus.cc:2781] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 5 FOLLOWER]: Leader election won for term 5
I20260809 12:03:39.777669 10832 raft_consensus.cc:686] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 5 LEADER]: Becoming Leader. State: Replica: abee08c3147547cc8f3379b5fc437835, State: Running, Role: LEADER
I20260809 12:03:39.778304 9300 heartbeater.cc:347] Connected to a master server at 127.8.15.124:33307
I20260809 12:03:39.778311 10832 consensus_queue.cc:237] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 44, Committed index: 44, Last appended: 4.44, Last appended by leader: 44, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:39.780661 10731 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" instance_seqno: 1786277008701240) as {username='slave'} at 127.8.15.65:36881; Asking this server to re-register.
I20260809 12:03:39.780455 10843 sys_catalog.cc:455] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: SysCatalogTable state changed. Reason: New leader abee08c3147547cc8f3379b5fc437835. Latest consensus state: current_term: 5 leader_uuid: "abee08c3147547cc8f3379b5fc437835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:39.780864 10843 sys_catalog.cc:458] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: This master's current role is: LEADER
I20260809 12:03:39.781548 9300 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:39.782529 10845 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 12:03:39.783017 10731 ts_manager.cc:194] Registered new tserver with Master: f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
I20260809 12:03:39.785413 10845 catalog_manager.cc:669] Loaded metadata for table default.table_da029d70439d48cc842a66906f93d903 [id=085a7a8b72ea4da2817e62d516fbcc38]
I20260809 12:03:39.785845 10845 catalog_manager.cc:669] Loaded metadata for table default.table_8ccd04aad0ba4f5480308b917eb8a12e [id=325c41115c9d4a16820f3f3e2c53ab6b]
I20260809 12:03:39.786221 10845 catalog_manager.cc:669] Loaded metadata for table default.table_e97f6ba8b3354e24926902268c43a5e3 [id=5239b7194cf944d881c8c4b6113b0dfa]
I20260809 12:03:39.786566 10845 catalog_manager.cc:669] Loaded metadata for table default.table_1692567d64f8469c8550ff24a79d3e57 [id=560f9d6ae1904b3ba73a0b3ed65fddbe]
I20260809 12:03:39.786867 10845 catalog_manager.cc:669] Loaded metadata for table default.table_22580336a00e422aab032707ca16836e [id=6999f70d421f4417b855c361afdebc21]
I20260809 12:03:39.787240 10845 catalog_manager.cc:669] Loaded metadata for table default.table_520e75ee39c74e6985dbd81c6f2e32f8 [id=78883a236d6b4026a725d3a3cc60dec1]
I20260809 12:03:39.787606 10845 catalog_manager.cc:669] Loaded metadata for table default.table_939805886d394093ad5a402efa777cb4 [id=87a2e7cf29fa4fdc8d5ea2173cdc1c2d]
I20260809 12:03:39.787917 10845 catalog_manager.cc:669] Loaded metadata for table default.table_22e16baa34234ab0a0b7841c1041884c [id=a090addd1b9f4126b16d72d49ac02669]
I20260809 12:03:39.788230 10845 catalog_manager.cc:669] Loaded metadata for table default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf]
I20260809 12:03:39.790172 10845 tablet_loader.cc:96] loaded metadata for tablet 013985779fe948f5b8a226502497aa2f (table default.table_22580336a00e422aab032707ca16836e [id=6999f70d421f4417b855c361afdebc21])
I20260809 12:03:39.790838 10845 tablet_loader.cc:96] loaded metadata for tablet 2e7c9b8049094f84ab877baba38947c8 (table default.table_da029d70439d48cc842a66906f93d903 [id=085a7a8b72ea4da2817e62d516fbcc38])
I20260809 12:03:39.791126 10845 tablet_loader.cc:96] loaded metadata for tablet 3366ce108f824dc2a04e38b230c4ba88 (table default.table_22e16baa34234ab0a0b7841c1041884c [id=a090addd1b9f4126b16d72d49ac02669])
I20260809 12:03:39.791704 10845 tablet_loader.cc:96] loaded metadata for tablet 67e9ded6eae9402a873f21c7219fed24 (table default.table_8ccd04aad0ba4f5480308b917eb8a12e [id=325c41115c9d4a16820f3f3e2c53ab6b])
I20260809 12:03:39.791961 10845 tablet_loader.cc:96] loaded metadata for tablet 6e51d6c18fd34cf29dd0ac00e81a4a8c (table default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf])
I20260809 12:03:39.792410 10845 tablet_loader.cc:96] loaded metadata for tablet 76a803b3bb8844068c58fd4fc8f57e37 (table default.table_e97f6ba8b3354e24926902268c43a5e3 [id=5239b7194cf944d881c8c4b6113b0dfa])
I20260809 12:03:39.793051 10845 tablet_loader.cc:96] loaded metadata for tablet ce8a862530c448fa9c6241462a998723 (table default.table_939805886d394093ad5a402efa777cb4 [id=87a2e7cf29fa4fdc8d5ea2173cdc1c2d])
I20260809 12:03:39.793422 10845 tablet_loader.cc:96] loaded metadata for tablet d8214eed04f14bd5bbe3a79b549fa71c (table default.table_1692567d64f8469c8550ff24a79d3e57 [id=560f9d6ae1904b3ba73a0b3ed65fddbe])
I20260809 12:03:39.793735 10845 tablet_loader.cc:96] loaded metadata for tablet f2b1d869fa714372bb2bdce7e9bcdfa8 (table default.table_520e75ee39c74e6985dbd81c6f2e32f8 [id=78883a236d6b4026a725d3a3cc60dec1])
I20260809 12:03:39.793987 10845 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 12:03:39.795313 10845 catalog_manager.cc:1259] Loaded cluster ID: a0f048c3ad03482e99d22bfc404ede58
I20260809 12:03:39.795428 10845 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 12:03:39.797144 10845 catalog_manager.cc:1504] Loading token signing keys...
I20260809 12:03:39.798231 10845 catalog_manager.cc:5879] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835: Loaded TSK: 0
I20260809 12:03:39.799108 10845 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 12:03:39.800137 10845 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260809 12:03:39.801198 10845 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: -1
I20260809 12:03:39.823432 10072 master_service.cc:946] ReplaceTablet: received request to replace tablet 3366ce108f824dc2a04e38b230c4ba88 from {username='slave'} at 127.0.0.1:46812
I20260809 12:03:39.823581 10068 master_service.cc:946] ReplaceTablet: received request to replace tablet ce8a862530c448fa9c6241462a998723 from {username='slave'} at 127.0.0.1:46812
I20260809 12:03:39.824690 10067 master_service.cc:946] ReplaceTablet: received request to replace tablet 2e7c9b8049094f84ab877baba38947c8 from {username='slave'} at 127.0.0.1:46812
I20260809 12:03:39.824815 10069 master_service.cc:946] ReplaceTablet: received request to replace tablet 013985779fe948f5b8a226502497aa2f from {username='slave'} at 127.0.0.1:46812
I20260809 12:03:39.828329 10066 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46812:
table { table_name: "default.Table_520e75ee39c74e6985dbd81c6f2e32f8" } modify_external_catalogs: true
I20260809 12:03:39.828873 10066 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46812:
table { table_name: "default.Table_520e75ee39c74e6985dbd81c6f2e32f8" } modify_external_catalogs: true
W20260809 12:03:39.831027 10052 consensus_peers.cc:487] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 -> Peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Couldn't send request to peer 061d8c3603f14343920d858e640b9dfd. Status: Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 12:03:39.832609 10064 master_service.cc:946] ReplaceTablet: received request to replace tablet 85bb8662f3174951bbdb45c8fcbaa975 from {username='slave'} at 127.0.0.1:46812
I20260809 12:03:39.833425 10065 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46812:
name: "default.Table_19152f3d2b804962b678450f144cbb7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:39.833037 10063 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46812:
table { table_name: "default.Table_e97f6ba8b3354e24926902268c43a5e3" } modify_external_catalogs: true
I20260809 12:03:39.833650 10062 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46812:
name: "default.Table_20e68010fb344d51ae82c39f2a5b6520"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:39.834594 10063 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46812:
table { table_name: "default.Table_e97f6ba8b3354e24926902268c43a5e3" } modify_external_catalogs: true
I20260809 12:03:39.835150 10064 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46812:
table { table_name: "default.Table_22580336a00e422aab032707ca16836e" } modify_external_catalogs: true
I20260809 12:03:39.835418 10064 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46812:
table { table_name: "default.Table_22580336a00e422aab032707ca16836e" } modify_external_catalogs: true
I20260809 12:03:39.837373 10748 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 5 FOLLOWER]: Refusing update from remote peer abee08c3147547cc8f3379b5fc437835: Log matching property violated. Preceding OpId in replica: term: 2 index: 30. Preceding OpId from leader: term: 5 index: 46. (index mismatch)
I20260809 12:03:39.838143 10832 consensus_queue.cc:1035] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 45, Last known committed idx: 30, Time since last communication: 0.000s
I20260809 12:03:39.838999 10059 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46812:
name: "default.Table_23a7e0a1a33a491ea66728c96d558eef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
F20260809 12:03:39.840221 10167 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 1): 1 CREATE_TABLE default.table_badbfc92917e45a5aa60e47244ae5ff5
*** Check failure stack trace: ***
@ 0x7fe2518c29ad google::LogMessage::Fail() at ??:0
@ 0x7fe2518c588a google::LogMessage::SendToLog() at ??:0
@ 0x7fe2518c24de google::LogMessage::Flush() at ??:0
@ 0x7fe2518c26d1 google::LogMessage::~LogMessage() at ??:0
@ 0x7fe267460ba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260809 12:03:39.854763 10864 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "abee08c3147547cc8f3379b5fc437835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:39.855257 10864 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:39.855639 10803 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader abee08c3147547cc8f3379b5fc437835. Latest consensus state: current_term: 5 leader_uuid: "abee08c3147547cc8f3379b5fc437835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:39.855934 10803 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:39.856283 10859 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "abee08c3147547cc8f3379b5fc437835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:39.856632 10859 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:39.860453 10067 catalog_manager.cc:5782] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835: Sending DeleteTablet for 3 replicas of tablet 2e7c9b8049094f84ab877baba38947c8
I20260809 12:03:39.862609 10067 catalog_manager.cc:6565] ReplaceTablet: tablet 2e7c9b8049094f84ab877baba38947c8 deleted and replaced by tablet eb1084478c8043ce860c786130f25350
@ 0x7fe26745f901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260809 12:03:39.865594 10851 mvcc.cc:205] Tried to move back new op lower bound from 7316590662200422400 to 7316590645928734720. Current Snapshot: MvccSnapshot[applied={T|T < 7316590662200422400 or (T in {7316590662200422400})}]
I20260809 12:03:39.873720 10072 catalog_manager.cc:5782] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835: Sending DeleteTablet for 3 replicas of tablet 3366ce108f824dc2a04e38b230c4ba88
I20260809 12:03:39.874290 10072 catalog_manager.cc:6565] ReplaceTablet: tablet 3366ce108f824dc2a04e38b230c4ba88 deleted and replaced by tablet 776e37328c3c4c5f8a3477300ef747fa
I20260809 12:03:39.876907 10859 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "abee08c3147547cc8f3379b5fc437835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:39.877169 10859 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:39.892153 10069 catalog_manager.cc:5782] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835: Sending DeleteTablet for 3 replicas of tablet 013985779fe948f5b8a226502497aa2f
@ 0x7fe26746666c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260809 12:03:39.892616 9193 tablet_service.cc:1514] Processing DeleteTablet for tablet 3366ce108f824dc2a04e38b230c4ba88 with delete_type TABLET_DATA_DELETED (replaced by tablet 776e37328c3c4c5f8a3477300ef747fa) from {username='slave'} at 127.0.0.1:41266
I20260809 12:03:39.892722 10069 catalog_manager.cc:6565] ReplaceTablet: tablet 013985779fe948f5b8a226502497aa2f deleted and replaced by tablet 1c975cc8e50c41eaa6e0512666fa3892
I20260809 12:03:39.892971 9195 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e7c9b8049094f84ab877baba38947c8 with delete_type TABLET_DATA_DELETED (replaced by tablet eb1084478c8043ce860c786130f25350) from {username='slave'} at 127.0.0.1:41266
I20260809 12:03:39.893340 10068 catalog_manager.cc:5782] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835: Sending DeleteTablet for 3 replicas of tablet ce8a862530c448fa9c6241462a998723
I20260809 12:03:39.893805 10068 catalog_manager.cc:6565] ReplaceTablet: tablet ce8a862530c448fa9c6241462a998723 deleted and replaced by tablet 2e2f427c244f4438bcbf26ef6f5bb0e6
I20260809 12:03:39.894634 9195 tablet_service.cc:1514] Processing DeleteTablet for tablet 013985779fe948f5b8a226502497aa2f with delete_type TABLET_DATA_DELETED (replaced by tablet 1c975cc8e50c41eaa6e0512666fa3892) from {username='slave'} at 127.0.0.1:41266
I20260809 12:03:39.894802 9198 tablet_service.cc:1514] Processing DeleteTablet for tablet ce8a862530c448fa9c6241462a998723 with delete_type TABLET_DATA_DELETED (replaced by tablet 2e2f427c244f4438bcbf26ef6f5bb0e6) from {username='slave'} at 127.0.0.1:41266
@ 0x7fe2674664e9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
I20260809 12:03:39.899076 9425 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e7c9b8049094f84ab877baba38947c8 with delete_type TABLET_DATA_DELETED (replaced by tablet eb1084478c8043ce860c786130f25350) from {username='slave'} at 127.0.0.1:44248
I20260809 12:03:39.899428 9423 tablet_service.cc:1514] Processing DeleteTablet for tablet 3366ce108f824dc2a04e38b230c4ba88 with delete_type TABLET_DATA_DELETED (replaced by tablet 776e37328c3c4c5f8a3477300ef747fa) from {username='slave'} at 127.0.0.1:44248
I20260809 12:03:39.899708 9427 tablet_service.cc:1514] Processing DeleteTablet for tablet 013985779fe948f5b8a226502497aa2f with delete_type TABLET_DATA_DELETED (replaced by tablet 1c975cc8e50c41eaa6e0512666fa3892) from {username='slave'} at 127.0.0.1:44248
I20260809 12:03:39.899889 9421 tablet_service.cc:1514] Processing DeleteTablet for tablet ce8a862530c448fa9c6241462a998723 with delete_type TABLET_DATA_DELETED (replaced by tablet 2e2f427c244f4438bcbf26ef6f5bb0e6) from {username='slave'} at 127.0.0.1:44248
@ 0x7fe2544eceaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fe2577c66db start_thread at ??:0
I20260809 12:03:39.906935 9640 tablet_service.cc:1514] Processing DeleteTablet for tablet ce8a862530c448fa9c6241462a998723 with delete_type TABLET_DATA_DELETED (replaced by tablet 2e2f427c244f4438bcbf26ef6f5bb0e6) from {username='slave'} at 127.0.0.1:56450
I20260809 12:03:39.907157 9646 tablet_service.cc:1514] Processing DeleteTablet for tablet 3366ce108f824dc2a04e38b230c4ba88 with delete_type TABLET_DATA_DELETED (replaced by tablet 776e37328c3c4c5f8a3477300ef747fa) from {username='slave'} at 127.0.0.1:56450
I20260809 12:03:39.906924 9641 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e7c9b8049094f84ab877baba38947c8 with delete_type TABLET_DATA_DELETED (replaced by tablet eb1084478c8043ce860c786130f25350) from {username='slave'} at 127.0.0.1:56450
I20260809 12:03:39.907421 9647 tablet_service.cc:1514] Processing DeleteTablet for tablet 013985779fe948f5b8a226502497aa2f with delete_type TABLET_DATA_DELETED (replaced by tablet 1c975cc8e50c41eaa6e0512666fa3892) from {username='slave'} at 127.0.0.1:56450
I20260809 12:03:39.911700 10879 tablet_replica.cc:330] T 3366ce108f824dc2a04e38b230c4ba88 P f05528ac015e4f0cb0aa748afdc2c12e: stopping tablet replica
I20260809 12:03:39.911950 10879 raft_consensus.cc:2229] T 3366ce108f824dc2a04e38b230c4ba88 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 12:03:39.912261 10879 raft_consensus.cc:2258] T 3366ce108f824dc2a04e38b230c4ba88 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:39.912957 10879 ts_tablet_manager.cc:1905] T 3366ce108f824dc2a04e38b230c4ba88 P f05528ac015e4f0cb0aa748afdc2c12e: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7fe25075c61f clone at ??:0
I20260809 12:03:39.920295 10879 ts_tablet_manager.cc:1918] T 3366ce108f824dc2a04e38b230c4ba88 P f05528ac015e4f0cb0aa748afdc2c12e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:39.920447 10879 log.cc:1196] T 3366ce108f824dc2a04e38b230c4ba88 P f05528ac015e4f0cb0aa748afdc2c12e: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/wal/wals/3366ce108f824dc2a04e38b230c4ba88
I20260809 12:03:39.920914 10879 ts_tablet_manager.cc:1939] T 3366ce108f824dc2a04e38b230c4ba88 P f05528ac015e4f0cb0aa748afdc2c12e: Deleting consensus metadata
I20260809 12:03:39.921840 10883 tablet_replica.cc:330] T ce8a862530c448fa9c6241462a998723 P e0b5e4c0505c4122ae1349ee4beb5bd1: stopping tablet replica
I20260809 12:03:39.922003 10879 tablet_replica.cc:330] T 2e7c9b8049094f84ab877baba38947c8 P f05528ac015e4f0cb0aa748afdc2c12e: stopping tablet replica
I20260809 12:03:39.922015 10883 raft_consensus.cc:2229] T ce8a862530c448fa9c6241462a998723 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 12:03:39.922194 10879 raft_consensus.cc:2229] T 2e7c9b8049094f84ab877baba38947c8 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 12:03:39.922212 10883 raft_consensus.cc:2258] T ce8a862530c448fa9c6241462a998723 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:39.922333 10879 raft_consensus.cc:2258] T 2e7c9b8049094f84ab877baba38947c8 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:39.922735 10883 ts_tablet_manager.cc:1905] T ce8a862530c448fa9c6241462a998723 P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:39.922783 10879 ts_tablet_manager.cc:1905] T 2e7c9b8049094f84ab877baba38947c8 P f05528ac015e4f0cb0aa748afdc2c12e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:39.928251 10882 tablet_replica.cc:330] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796: stopping tablet replica
I20260809 12:03:39.928440 10882 raft_consensus.cc:2229] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 LEADER]: Raft consensus shutting down.
I20260809 12:03:39.928733 10882 raft_consensus.cc:2258] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:39.929345 10882 ts_tablet_manager.cc:1905] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:39.933692 10883 ts_tablet_manager.cc:1918] T ce8a862530c448fa9c6241462a998723 P e0b5e4c0505c4122ae1349ee4beb5bd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:39.933836 10883 log.cc:1196] T ce8a862530c448fa9c6241462a998723 P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/wal/wals/ce8a862530c448fa9c6241462a998723
I20260809 12:03:39.934250 10883 ts_tablet_manager.cc:1939] T ce8a862530c448fa9c6241462a998723 P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting consensus metadata
I20260809 12:03:39.935348 10883 tablet_replica.cc:330] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1: stopping tablet replica
I20260809 12:03:39.935561 10879 ts_tablet_manager.cc:1918] T 2e7c9b8049094f84ab877baba38947c8 P f05528ac015e4f0cb0aa748afdc2c12e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:39.935570 10883 raft_consensus.cc:2229] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 LEADER]: Raft consensus shutting down.
I20260809 12:03:39.935696 10879 log.cc:1196] T 2e7c9b8049094f84ab877baba38947c8 P f05528ac015e4f0cb0aa748afdc2c12e: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/wal/wals/2e7c9b8049094f84ab877baba38947c8
I20260809 12:03:39.935995 10879 ts_tablet_manager.cc:1939] T 2e7c9b8049094f84ab877baba38947c8 P f05528ac015e4f0cb0aa748afdc2c12e: Deleting consensus metadata
I20260809 12:03:39.936018 10883 raft_consensus.cc:2258] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:39.936060 10882 ts_tablet_manager.cc:1918] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:39.936190 10882 log.cc:1196] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/wal/wals/2e7c9b8049094f84ab877baba38947c8
I20260809 12:03:39.936609 10882 ts_tablet_manager.cc:1939] T 2e7c9b8049094f84ab877baba38947c8 P cde39fbb4ced4d049fef6754c3f3e796: Deleting consensus metadata
I20260809 12:03:39.936655 10883 ts_tablet_manager.cc:1905] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:39.936793 10879 tablet_replica.cc:330] T 013985779fe948f5b8a226502497aa2f P f05528ac015e4f0cb0aa748afdc2c12e: stopping tablet replica
I20260809 12:03:39.937002 10879 raft_consensus.cc:2229] T 013985779fe948f5b8a226502497aa2f P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 12:03:39.937191 10879 raft_consensus.cc:2258] T 013985779fe948f5b8a226502497aa2f P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:39.937696 10882 tablet_replica.cc:330] T 3366ce108f824dc2a04e38b230c4ba88 P cde39fbb4ced4d049fef6754c3f3e796: stopping tablet replica
I20260809 12:03:39.937736 10879 ts_tablet_manager.cc:1905] T 013985779fe948f5b8a226502497aa2f P f05528ac015e4f0cb0aa748afdc2c12e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:39.937907 10882 raft_consensus.cc:2229] T 3366ce108f824dc2a04e38b230c4ba88 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 12:03:39.938061 10882 raft_consensus.cc:2258] T 3366ce108f824dc2a04e38b230c4ba88 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:39.938560 10882 ts_tablet_manager.cc:1905] T 3366ce108f824dc2a04e38b230c4ba88 P cde39fbb4ced4d049fef6754c3f3e796: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:39.942530 10883 ts_tablet_manager.cc:1918] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:39.942659 10883 log.cc:1196] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/wal/wals/3366ce108f824dc2a04e38b230c4ba88
I20260809 12:03:39.943035 10883 ts_tablet_manager.cc:1939] T 3366ce108f824dc2a04e38b230c4ba88 P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting consensus metadata
I20260809 12:03:39.943954 10879 ts_tablet_manager.cc:1918] T 013985779fe948f5b8a226502497aa2f P f05528ac015e4f0cb0aa748afdc2c12e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:39.944092 10879 log.cc:1196] T 013985779fe948f5b8a226502497aa2f P f05528ac015e4f0cb0aa748afdc2c12e: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/wal/wals/013985779fe948f5b8a226502497aa2f
I20260809 12:03:39.944502 10879 ts_tablet_manager.cc:1939] T 013985779fe948f5b8a226502497aa2f P f05528ac015e4f0cb0aa748afdc2c12e: Deleting consensus metadata
I20260809 12:03:39.944633 10882 ts_tablet_manager.cc:1918] T 3366ce108f824dc2a04e38b230c4ba88 P cde39fbb4ced4d049fef6754c3f3e796: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:39.944768 10882 log.cc:1196] T 3366ce108f824dc2a04e38b230c4ba88 P cde39fbb4ced4d049fef6754c3f3e796: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/wal/wals/3366ce108f824dc2a04e38b230c4ba88
I20260809 12:03:39.945122 10882 ts_tablet_manager.cc:1939] T 3366ce108f824dc2a04e38b230c4ba88 P cde39fbb4ced4d049fef6754c3f3e796: Deleting consensus metadata
I20260809 12:03:39.945478 10879 tablet_replica.cc:330] T ce8a862530c448fa9c6241462a998723 P f05528ac015e4f0cb0aa748afdc2c12e: stopping tablet replica
I20260809 12:03:39.945680 10879 raft_consensus.cc:2229] T ce8a862530c448fa9c6241462a998723 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 12:03:39.945848 10879 raft_consensus.cc:2258] T ce8a862530c448fa9c6241462a998723 P f05528ac015e4f0cb0aa748afdc2c12e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:39.946139 10882 tablet_replica.cc:330] T 013985779fe948f5b8a226502497aa2f P cde39fbb4ced4d049fef6754c3f3e796: stopping tablet replica
I20260809 12:03:39.946321 10882 raft_consensus.cc:2229] T 013985779fe948f5b8a226502497aa2f P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 12:03:39.946420 10879 ts_tablet_manager.cc:1905] T ce8a862530c448fa9c6241462a998723 P f05528ac015e4f0cb0aa748afdc2c12e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:39.946496 10882 raft_consensus.cc:2258] T 013985779fe948f5b8a226502497aa2f P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:39.947016 10882 ts_tablet_manager.cc:1905] T 013985779fe948f5b8a226502497aa2f P cde39fbb4ced4d049fef6754c3f3e796: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:39.948274 10883 tablet_replica.cc:330] T 2e7c9b8049094f84ab877baba38947c8 P e0b5e4c0505c4122ae1349ee4beb5bd1: stopping tablet replica
I20260809 12:03:39.948464 10883 raft_consensus.cc:2229] T 2e7c9b8049094f84ab877baba38947c8 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 12:03:39.948642 10883 raft_consensus.cc:2258] T 2e7c9b8049094f84ab877baba38947c8 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:39.950546 10883 ts_tablet_manager.cc:1905] T 2e7c9b8049094f84ab877baba38947c8 P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:39.952467 10879 ts_tablet_manager.cc:1918] T ce8a862530c448fa9c6241462a998723 P f05528ac015e4f0cb0aa748afdc2c12e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:39.952490 10882 ts_tablet_manager.cc:1918] T 013985779fe948f5b8a226502497aa2f P cde39fbb4ced4d049fef6754c3f3e796: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:39.952603 10879 log.cc:1196] T ce8a862530c448fa9c6241462a998723 P f05528ac015e4f0cb0aa748afdc2c12e: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-0/wal/wals/ce8a862530c448fa9c6241462a998723
I20260809 12:03:39.952617 10882 log.cc:1196] T 013985779fe948f5b8a226502497aa2f P cde39fbb4ced4d049fef6754c3f3e796: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/wal/wals/013985779fe948f5b8a226502497aa2f
I20260809 12:03:39.953016 10882 ts_tablet_manager.cc:1939] T 013985779fe948f5b8a226502497aa2f P cde39fbb4ced4d049fef6754c3f3e796: Deleting consensus metadata
I20260809 12:03:39.953030 10879 ts_tablet_manager.cc:1939] T ce8a862530c448fa9c6241462a998723 P f05528ac015e4f0cb0aa748afdc2c12e: Deleting consensus metadata
I20260809 12:03:39.953994 10882 tablet_replica.cc:330] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796: stopping tablet replica
I20260809 12:03:39.954183 10882 raft_consensus.cc:2229] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 LEADER]: Raft consensus shutting down.
I20260809 12:03:39.954487 10882 raft_consensus.cc:2258] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:39.955029 10882 ts_tablet_manager.cc:1905] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:39.956736 10883 ts_tablet_manager.cc:1918] T 2e7c9b8049094f84ab877baba38947c8 P e0b5e4c0505c4122ae1349ee4beb5bd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:39.956853 10883 log.cc:1196] T 2e7c9b8049094f84ab877baba38947c8 P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/wal/wals/2e7c9b8049094f84ab877baba38947c8
I20260809 12:03:39.957227 10883 ts_tablet_manager.cc:1939] T 2e7c9b8049094f84ab877baba38947c8 P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting consensus metadata
I20260809 12:03:39.958120 10883 tablet_replica.cc:330] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1: stopping tablet replica
I20260809 12:03:39.958318 10883 raft_consensus.cc:2229] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 LEADER]: Raft consensus shutting down.
I20260809 12:03:39.958629 10883 raft_consensus.cc:2258] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:39.959160 10883 ts_tablet_manager.cc:1905] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 12:03:39.960604 10882 ts_tablet_manager.cc:1918] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:39.960731 10882 log.cc:1196] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-1/wal/wals/ce8a862530c448fa9c6241462a998723
I20260809 12:03:39.961113 10882 ts_tablet_manager.cc:1939] T ce8a862530c448fa9c6241462a998723 P cde39fbb4ced4d049fef6754c3f3e796: Deleting consensus metadata
I20260809 12:03:39.964689 10883 ts_tablet_manager.cc:1918] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:39.964833 10883 log.cc:1196] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/wal/wals/013985779fe948f5b8a226502497aa2f
I20260809 12:03:39.965255 10883 ts_tablet_manager.cc:1939] T 013985779fe948f5b8a226502497aa2f P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting consensus metadata
W20260809 12:03:40.149863 9352 connection.cc:535] server connection from 127.0.0.1:44248 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:40.149945 9571 connection.cc:535] server connection from 127.0.0.1:56450 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:40.149999 9127 connection.cc:535] server connection from 127.0.0.1:41266 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:40.150774 9780 connection.cc:535] client connection to 127.8.15.126:45327 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:40.151527 9780 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.8.15.126:45327)
W20260809 12:03:40.152247 9780 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.8.15.126:45327)
W20260809 12:03:40.152478 9780 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.8.15.126:45327)
W20260809 12:03:40.152940 9780 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.8.15.126:45327)
I20260809 12:03:40.372802 10859 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abee08c3147547cc8f3379b5fc437835)
I20260809 12:03:40.373139 10859 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:40.375355 10859 leader_election.cc:288] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165)
W20260809 12:03:40.376974 10711 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:03:40.379031 10708 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
W20260809 12:03:40.379349 10711 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:03:40.379513 10711 leader_election.cc:302] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e38ce37027547efa06785b9247f59bc; no voters: 061d8c3603f14343920d858e640b9dfd, abee08c3147547cc8f3379b5fc437835
I20260809 12:03:40.379971 10859 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260809 12:03:41.117705 10915 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abee08c3147547cc8f3379b5fc437835)
I20260809 12:03:41.117899 10915 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:41.118567 10915 leader_election.cc:288] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165)
W20260809 12:03:41.121004 10711 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:03:41.121150 10708 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
I20260809 12:03:41.121315 10708 leader_election.cc:302] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e38ce37027547efa06785b9247f59bc; no voters: 061d8c3603f14343920d858e640b9dfd, abee08c3147547cc8f3379b5fc437835
I20260809 12:03:41.121557 10915 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260809 12:03:42.137503 10929 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abee08c3147547cc8f3379b5fc437835)
I20260809 12:03:42.137719 10929 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:42.138368 10929 leader_election.cc:288] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165)
W20260809 12:03:42.140690 10711 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:03:42.140868 10708 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
I20260809 12:03:42.141002 10708 leader_election.cc:302] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e38ce37027547efa06785b9247f59bc; no voters: 061d8c3603f14343920d858e640b9dfd, abee08c3147547cc8f3379b5fc437835
I20260809 12:03:42.141218 10929 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260809 12:03:42.142915 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 6: this message will repeat every 5th retry.
I20260809 12:03:42.409106 8253 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
/tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.15.125:37165
--webserver_interface=127.8.15.125
--webserver_port=41665
--builtin_ntp_servers=127.8.15.84:46271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--hive_metastore_uris=thrift://127.0.0.1:44923
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260809 12:03:42.480427 10597 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:03:42.480675 10597 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:42.481519 10597 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:03:42.482497 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:03:42.482688 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:03:42.482838 9571 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:03:42.483099 10597 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260809 12:03:42.751641 10944 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 12:03:42.751930 10944 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 12:03:42.752028 10944 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 12:03:42.759553 10944 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 12:03:42.759650 10944 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 12:03:42.759716 10944 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 12:03:42.759790 10944 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 12:03:42.769315 10944 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.15.84:46271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:44923
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.15.125:37165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.15.125
--webserver_port=41665
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:06:41 UTC on ccycloud.quasar-bwoogy.root.comops.site
build id 4575991
ASAN enabled
I20260809 12:03:42.770677 10944 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 12:03:42.772544 10944 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 12:03:42.784098 10957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:42.784153 10960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:42.784570 10958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 12:03:42.785070 10944 server_base.cc:1034] running on GCE node
I20260809 12:03:42.785887 10944 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 12:03:42.786604 10963 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abee08c3147547cc8f3379b5fc437835)
I20260809 12:03:42.786810 10963 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:42.787608 10944 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 12:03:42.791035 10944 hybrid_clock.cc:648] HybridClock initialized: now 1786277022790290 us; error 687 us; skew 500 ppm
I20260809 12:03:42.791563 10944 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260809 12:03:42.791596 10711 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:03:42.793802 10963 leader_election.cc:288] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165)
W20260809 12:03:42.796412 10708 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
I20260809 12:03:42.796592 10708 leader_election.cc:302] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e38ce37027547efa06785b9247f59bc; no voters: 061d8c3603f14343920d858e640b9dfd, abee08c3147547cc8f3379b5fc437835
I20260809 12:03:42.796911 10963 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260809 12:03:42.798005 10944 webserver.cc:460] Webserver started at http://127.8.15.125:41665/ using document root <none> and password file <none>
I20260809 12:03:42.798725 10944 fs_manager.cc:359] Metadata directory not provided
I20260809 12:03:42.798833 10944 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 12:03:42.804244 10944 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 12:03:42.807191 10973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 12:03:42.808543 10944 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 12:03:42.808717 10944 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data,/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/wal
uuid: "061d8c3603f14343920d858e640b9dfd"
format_stamp: "Formatted at 2026-08-09 12:03:26 on dist-test-slave-21b9"
I20260809 12:03:42.809712 10944 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 12:03:42.851693 10944 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 12:03:42.852771 10944 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 12:03:42.853046 10944 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 12:03:42.870946 10944 rpc_server.cc:307] RPC server started. Bound to: 127.8.15.125:37165
I20260809 12:03:42.870965 11058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.15.125:37165 every 8 connection(s)
I20260809 12:03:42.872510 10944 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data/info.pb
I20260809 12:03:42.878768 8253 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu as pid 10944
I20260809 12:03:42.879516 11060 sys_catalog.cc:263] Verifying existing consensus state
I20260809 12:03:42.883703 11060 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: Bootstrap starting.
I20260809 12:03:42.895706 11060 log.cc:824] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: Log is configured to *not* fsync() on all Append() calls
I20260809 12:03:42.932549 11060 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: Bootstrap replayed 1/1 log segments. Stats: ops{read=44 overwritten=0 applied=44 ignored=0} inserts{seen=31 ignored=0} mutations{seen=37 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 12:03:42.933106 11060 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: Bootstrap complete.
I20260809 12:03:42.940907 11060 raft_consensus.cc:348] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:42.942274 11060 raft_consensus.cc:729] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: 061d8c3603f14343920d858e640b9dfd, State: Initialized, Role: FOLLOWER
I20260809 12:03:42.943048 11060 consensus_queue.cc:260] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 44, Last appended: 4.44, Last appended by leader: 44, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:42.943970 11065 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:42.944427 11065 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:42.945303 11060 sys_catalog.cc:564] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 12:03:42.965106 11083 catalog_manager.cc:1259] Loaded cluster ID: a0f048c3ad03482e99d22bfc404ede58
I20260809 12:03:42.965306 11083 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: loading cluster ID for follower catalog manager: success
I20260809 12:03:42.971859 11083 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: acquiring CA information for follower catalog manager: success
I20260809 12:03:42.976950 11083 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 12:03:42.964957 10944 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:03:42.978076 10944 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:03:43.063771 9766 heartbeater.cc:347] Connected to a master server at 127.8.15.125:37165
I20260809 12:03:43.070151 11013 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" instance_seqno: 1786277010606266) as {username='slave'} at 127.8.15.67:55235; Asking this server to re-register.
I20260809 12:03:43.071156 9766 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:43.073675 11013 ts_manager.cc:194] Registered new tserver with Master: e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:43.261933 9530 heartbeater.cc:347] Connected to a master server at 127.8.15.125:37165
I20260809 12:03:43.263697 11013 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" instance_seqno: 1786277009716171) as {username='slave'} at 127.8.15.66:36193; Asking this server to re-register.
I20260809 12:03:43.264405 9530 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:43.265715 11013 ts_manager.cc:194] Registered new tserver with Master: cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479)
I20260809 12:03:43.294245 9308 heartbeater.cc:347] Connected to a master server at 127.8.15.125:37165
I20260809 12:03:43.296269 11013 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" instance_seqno: 1786277008701240) as {username='slave'} at 127.8.15.65:49261; Asking this server to re-register.
I20260809 12:03:43.296928 9308 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:43.298450 11013 ts_manager.cc:194] Registered new tserver with Master: f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
I20260809 12:03:43.556634 11097 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:43.556943 11097 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:43.558791 11097 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:03:43.560575 10978 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:03:43.562179 10978 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:03:43.565629 10748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "061d8c3603f14343920d858e640b9dfd" candidate_term: 5 candidate_status { last_received { term: 4 index: 44 } } ignore_live_leader: false dest_uuid: "1e38ce37027547efa06785b9247f59bc" is_pre_election: true
I20260809 12:03:43.565932 10748 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 061d8c3603f14343920d858e640b9dfd in current term 5: Already voted for candidate abee08c3147547cc8f3379b5fc437835 in this term.
I20260809 12:03:43.566669 10980 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:03:43.567049 11097 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 4 FOLLOWER]: Advancing to term 5
I20260809 12:03:43.571151 11097 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260809 12:03:43.682559 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 6: this message will repeat every 5th retry.
I20260809 12:03:44.025549 11110 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader abee08c3147547cc8f3379b5fc437835)
I20260809 12:03:44.025763 11110 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:44.026460 11110 leader_election.cc:288] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165)
W20260809 12:03:44.029037 10711 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:03:44.034237 11025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e38ce37027547efa06785b9247f59bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 49 } } ignore_live_leader: false dest_uuid: "061d8c3603f14343920d858e640b9dfd" is_pre_election: true
I20260809 12:03:44.034763 11025 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e38ce37027547efa06785b9247f59bc in term 5.
I20260809 12:03:44.035369 10708 leader_election.cc:302] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd, 1e38ce37027547efa06785b9247f59bc; no voters: abee08c3147547cc8f3379b5fc437835
I20260809 12:03:44.035701 11110 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260809 12:03:44.035813 11110 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 5 FOLLOWER]: Starting leader election (detected failure of leader abee08c3147547cc8f3379b5fc437835)
I20260809 12:03:44.035914 11110 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 5 FOLLOWER]: Advancing to term 6
I20260809 12:03:44.037897 11110 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:44.038486 11110 leader_election.cc:288] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 6 election: Requested vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165)
I20260809 12:03:44.038970 11025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e38ce37027547efa06785b9247f59bc" candidate_term: 6 candidate_status { last_received { term: 5 index: 49 } } ignore_live_leader: false dest_uuid: "061d8c3603f14343920d858e640b9dfd"
I20260809 12:03:44.039155 11025 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 5 FOLLOWER]: Advancing to term 6
W20260809 12:03:44.039994 10711 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:03:44.041280 11025 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e38ce37027547efa06785b9247f59bc in term 6.
I20260809 12:03:44.041666 10708 leader_election.cc:302] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd, 1e38ce37027547efa06785b9247f59bc; no voters: abee08c3147547cc8f3379b5fc437835
I20260809 12:03:44.041961 11110 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 6 FOLLOWER]: Leader election won for term 6
I20260809 12:03:44.042382 11110 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 6 LEADER]: Becoming Leader. State: Replica: 1e38ce37027547efa06785b9247f59bc, State: Running, Role: LEADER
I20260809 12:03:44.042833 11110 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 49, Committed index: 49, Last appended: 5.49, Last appended by leader: 49, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:44.044471 11120 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e38ce37027547efa06785b9247f59bc. Latest consensus state: current_term: 6 leader_uuid: "1e38ce37027547efa06785b9247f59bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:44.044835 11120 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: This master's current role is: LEADER
I20260809 12:03:44.045498 11122 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 12:03:44.048303 11122 catalog_manager.cc:669] Loaded metadata for table default.table_da029d70439d48cc842a66906f93d903 [id=085a7a8b72ea4da2817e62d516fbcc38]
I20260809 12:03:44.048748 11122 catalog_manager.cc:669] Loaded metadata for table default.table_8ccd04aad0ba4f5480308b917eb8a12e [id=325c41115c9d4a16820f3f3e2c53ab6b]
I20260809 12:03:44.049124 11122 catalog_manager.cc:669] Loaded metadata for table default.table_e97f6ba8b3354e24926902268c43a5e3 [id=5239b7194cf944d881c8c4b6113b0dfa]
I20260809 12:03:44.049470 11122 catalog_manager.cc:669] Loaded metadata for table default.table_1692567d64f8469c8550ff24a79d3e57 [id=560f9d6ae1904b3ba73a0b3ed65fddbe]
I20260809 12:03:44.049774 11122 catalog_manager.cc:669] Loaded metadata for table default.table_22580336a00e422aab032707ca16836e [id=6999f70d421f4417b855c361afdebc21]
I20260809 12:03:44.050096 11122 catalog_manager.cc:669] Loaded metadata for table default.table_520e75ee39c74e6985dbd81c6f2e32f8 [id=78883a236d6b4026a725d3a3cc60dec1]
I20260809 12:03:44.050410 11122 catalog_manager.cc:669] Loaded metadata for table default.table_939805886d394093ad5a402efa777cb4 [id=87a2e7cf29fa4fdc8d5ea2173cdc1c2d]
I20260809 12:03:44.050711 11122 catalog_manager.cc:669] Loaded metadata for table default.table_22e16baa34234ab0a0b7841c1041884c [id=a090addd1b9f4126b16d72d49ac02669]
I20260809 12:03:44.051005 11122 catalog_manager.cc:669] Loaded metadata for table default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf]
I20260809 12:03:44.053344 11122 tablet_loader.cc:96] loaded metadata for tablet 1c975cc8e50c41eaa6e0512666fa3892 (table default.table_22580336a00e422aab032707ca16836e [id=6999f70d421f4417b855c361afdebc21])
I20260809 12:03:44.053746 11122 tablet_loader.cc:96] loaded metadata for tablet 2e2f427c244f4438bcbf26ef6f5bb0e6 (table default.table_939805886d394093ad5a402efa777cb4 [id=87a2e7cf29fa4fdc8d5ea2173cdc1c2d])
I20260809 12:03:44.054544 11122 tablet_loader.cc:96] loaded metadata for tablet 67e9ded6eae9402a873f21c7219fed24 (table default.table_8ccd04aad0ba4f5480308b917eb8a12e [id=325c41115c9d4a16820f3f3e2c53ab6b])
I20260809 12:03:44.054791 11122 tablet_loader.cc:96] loaded metadata for tablet 6e51d6c18fd34cf29dd0ac00e81a4a8c (table default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf])
I20260809 12:03:44.055188 11122 tablet_loader.cc:96] loaded metadata for tablet 76a803b3bb8844068c58fd4fc8f57e37 (table default.table_e97f6ba8b3354e24926902268c43a5e3 [id=5239b7194cf944d881c8c4b6113b0dfa])
I20260809 12:03:44.055433 11122 tablet_loader.cc:96] loaded metadata for tablet 776e37328c3c4c5f8a3477300ef747fa (table default.table_22e16baa34234ab0a0b7841c1041884c [id=a090addd1b9f4126b16d72d49ac02669])
I20260809 12:03:44.056175 11122 tablet_loader.cc:96] loaded metadata for tablet d8214eed04f14bd5bbe3a79b549fa71c (table default.table_1692567d64f8469c8550ff24a79d3e57 [id=560f9d6ae1904b3ba73a0b3ed65fddbe])
I20260809 12:03:44.056401 11122 tablet_loader.cc:96] loaded metadata for tablet eb1084478c8043ce860c786130f25350 (table default.table_da029d70439d48cc842a66906f93d903 [id=085a7a8b72ea4da2817e62d516fbcc38])
I20260809 12:03:44.056668 11122 tablet_loader.cc:96] loaded metadata for tablet f2b1d869fa714372bb2bdce7e9bcdfa8 (table default.table_520e75ee39c74e6985dbd81c6f2e32f8 [id=78883a236d6b4026a725d3a3cc60dec1])
I20260809 12:03:44.056902 11122 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 12:03:44.057971 11122 catalog_manager.cc:1259] Loaded cluster ID: a0f048c3ad03482e99d22bfc404ede58
I20260809 12:03:44.058048 11122 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 12:03:44.059506 11122 catalog_manager.cc:1504] Loading token signing keys...
I20260809 12:03:44.060813 11122 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: Loaded TSK: 0
W20260809 12:03:44.061648 9571 consensus_peers.cc:487] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c755c68ccba04ded80a352012364af5b. This is attempt 6: this message will repeat every 5th retry.
I20260809 12:03:44.062150 11122 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 12:03:44.063468 11122 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260809 12:03:44.064630 11122 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: -1
I20260809 12:03:44.111405 10731 master_service.cc:946] ReplaceTablet: received request to replace tablet 67e9ded6eae9402a873f21c7219fed24 from {username='slave'} at 127.0.0.1:42350
I20260809 12:03:44.111521 10735 master_service.cc:946] ReplaceTablet: received request to replace tablet d8214eed04f14bd5bbe3a79b549fa71c from {username='slave'} at 127.0.0.1:42350
I20260809 12:03:44.111721 10729 master_service.cc:946] ReplaceTablet: received request to replace tablet f2b1d869fa714372bb2bdce7e9bcdfa8 from {username='slave'} at 127.0.0.1:42350
I20260809 12:03:44.112154 10727 master_service.cc:946] ReplaceTablet: received request to replace tablet 85bb8662f3174951bbdb45c8fcbaa975 from {username='slave'} at 127.0.0.1:42350
I20260809 12:03:44.112942 10724 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42350:
name: "default.Table_ae991ee631804400852a07ac513507b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:44.112185 10728 master_service.cc:946] ReplaceTablet: received request to replace tablet 67e9ded6eae9402a873f21c7219fed24 from {username='slave'} at 127.0.0.1:42350
I20260809 12:03:44.115674 10727 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42350:
table { table_name: "default.Table_8ccd04aad0ba4f5480308b917eb8a12e" } new_table_name: "default.Table_489095aac0bc4bfaa46526a3f3a1f487" modify_external_catalogs: true
I20260809 12:03:44.115425 10720 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42350:
table { table_name: "default.Table_939805886d394093ad5a402efa777cb4" } new_table_name: "default.Table_fde2047ff905432799357dc11e5e179a" modify_external_catalogs: true
I20260809 12:03:44.114006 10726 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42350:
table { table_name: "default.Table_22e16baa34234ab0a0b7841c1041884c" } modify_external_catalogs: true
I20260809 12:03:44.115882 10722 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42350:
name: "default.Table_4a9ffe7028574d44a30d91abf82ef9be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:44.121374 10723 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42350:
name: "default.Table_fb4b5b675db040ba953c86b0d8309ec3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
F20260809 12:03:44.122781 10821 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 1): 1 CREATE_TABLE default.table_badbfc92917e45a5aa60e47244ae5ff5
*** Check failure stack trace: ***
@ 0x7f779e1939ad google::LogMessage::Fail() at ??:0
I20260809 12:03:44.122777 10726 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42350:
table { table_name: "default.Table_22e16baa34234ab0a0b7841c1041884c" } modify_external_catalogs: true
@ 0x7f779e19688a google::LogMessage::SendToLog() at ??:0
I20260809 12:03:44.127879 11025 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 6 FOLLOWER]: Refusing update from remote peer 1e38ce37027547efa06785b9247f59bc: Log matching property violated. Preceding OpId in replica: term: 4 index: 44. Preceding OpId from leader: term: 6 index: 52. (index mismatch)
@ 0x7f779e1934de google::LogMessage::Flush() at ??:0
@ 0x7f779e1936d1 google::LogMessage::~LogMessage() at ??:0
W20260809 12:03:44.131872 10711 consensus_peers.cc:487] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc -> Peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Couldn't send request to peer abee08c3147547cc8f3379b5fc437835. Status: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 12:03:44.133558 11120 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 50, Last known committed idx: 44, Time since last communication: 0.000s
@ 0x7f77b3d31ba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f77b3d30901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7f77b3d3766c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7f77b3d374e9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
I20260809 12:03:44.155092 11129 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e38ce37027547efa06785b9247f59bc. Latest consensus state: current_term: 6 leader_uuid: "1e38ce37027547efa06785b9247f59bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:44.155470 11129 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:44.155733 11138 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "1e38ce37027547efa06785b9247f59bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:44.155918 11138 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f77a0dbdeaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f77a40976db start_thread at ??:0
@ 0x7f779d02d61f clone at ??:0
I20260809 12:03:44.163826 11138 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "1e38ce37027547efa06785b9247f59bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:44.164047 11138 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: This master's current role is: FOLLOWER
W20260809 12:03:44.219622 9573 consensus_peers.cc:487] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c755c68ccba04ded80a352012364af5b. This is attempt 6: this message will repeat every 5th retry.
W20260809 12:03:44.334860 9128 connection.cc:535] client connection to 127.8.15.124:33307 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:44.334860 10975 connection.cc:535] server connection from 127.0.0.1:43188 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:44.335147 9352 connection.cc:535] client connection to 127.8.15.124:33307 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:44.335605 9782 connection.cc:535] client connection to 127.8.15.124:33307 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:44.335664 9575 connection.cc:535] client connection to 127.8.15.124:33307 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:44.336409 9782 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.8.15.124:33307)
W20260809 12:03:44.336714 9782 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.8.15.124:33307)
W20260809 12:03:44.337018 9782 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.8.15.124:33307)
W20260809 12:03:44.337610 9782 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.8.15.124:33307)
I20260809 12:03:44.659065 11138 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:03:44.659354 11138 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:44.660101 11138 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:03:44.662190 10978 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:03:44.662382 10980 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:03:44.662598 10980 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:03:44.662905 11138 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260809 12:03:45.306980 11181 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:03:45.307219 11181 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:45.307925 11181 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:03:45.309911 10980 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
W20260809 12:03:45.310127 10978 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:03:45.310235 10978 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:03:45.310443 11181 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260809 12:03:45.905241 11186 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:03:45.905441 11186 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:45.906101 11186 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:03:45.908084 10980 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
W20260809 12:03:45.908257 10978 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:03:45.908378 10978 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:03:45.908604 11186 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260809 12:03:46.030646 8253 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
/tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.15.126:45327
--webserver_interface=127.8.15.126
--webserver_port=37855
--builtin_ntp_servers=127.8.15.84:46271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--hive_metastore_uris=thrift://127.0.0.1:44923
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260809 12:03:46.375397 11193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 12:03:46.375715 11193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 12:03:46.375831 11193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 12:03:46.383116 11193 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 12:03:46.383234 11193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 12:03:46.383322 11193 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 12:03:46.383402 11193 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 12:03:46.392756 11193 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.15.84:46271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:44923
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.15.126:45327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.15.126
--webserver_port=37855
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:06:41 UTC on ccycloud.quasar-bwoogy.root.comops.site
build id 4575991
ASAN enabled
I20260809 12:03:46.394150 11193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 12:03:46.396009 11193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 12:03:46.407433 11205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:46.407459 11207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:46.407495 11210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 12:03:46.408154 11193 server_base.cc:1034] running on GCE node
I20260809 12:03:46.408978 11193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 12:03:46.410496 11193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 12:03:46.411705 11193 hybrid_clock.cc:648] HybridClock initialized: now 1786277026411639 us; error 42 us; skew 500 ppm
I20260809 12:03:46.412038 11193 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 12:03:46.414361 11193 webserver.cc:460] Webserver started at http://127.8.15.126:37855/ using document root <none> and password file <none>
I20260809 12:03:46.415053 11193 fs_manager.cc:359] Metadata directory not provided
I20260809 12:03:46.415171 11193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 12:03:46.421197 11193 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.004s
I20260809 12:03:46.424103 11218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 12:03:46.425400 11193 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 12:03:46.425576 11193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/data,/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/wal
uuid: "abee08c3147547cc8f3379b5fc437835"
format_stamp: "Formatted at 2026-08-09 12:03:25 on dist-test-slave-21b9"
I20260809 12:03:46.426563 11193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 12:03:46.466566 11193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 12:03:46.467545 11193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 12:03:46.467839 11193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 12:03:46.486572 11193 rpc_server.cc:307] RPC server started. Bound to: 127.8.15.126:45327
I20260809 12:03:46.486580 11301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.15.126:45327 every 8 connection(s)
I20260809 12:03:46.488173 11193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-0/data/info.pb
I20260809 12:03:46.493418 8253 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu as pid 11193
I20260809 12:03:46.495307 11302 sys_catalog.cc:263] Verifying existing consensus state
I20260809 12:03:46.499054 11302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835: Bootstrap starting.
I20260809 12:03:46.511332 11302 log.cc:824] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835: Log is configured to *not* fsync() on all Append() calls
I20260809 12:03:46.547284 11302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835: Bootstrap replayed 1/1 log segments. Stats: ops{read=49 overwritten=0 applied=49 ignored=0} inserts{seen=35 ignored=0} mutations{seen=41 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 12:03:46.547888 11302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835: Bootstrap complete.
I20260809 12:03:46.557960 11302 raft_consensus.cc:348] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:46.558923 11302 raft_consensus.cc:729] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: abee08c3147547cc8f3379b5fc437835, State: Initialized, Role: FOLLOWER
I20260809 12:03:46.559599 11302 consensus_queue.cc:260] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 49, Last appended: 5.49, Last appended by leader: 49, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:46.560393 11308 sys_catalog.cc:455] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:46.560721 11308 sys_catalog.cc:458] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:46.561478 11302 sys_catalog.cc:564] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 12:03:46.572219 11327 catalog_manager.cc:1259] Loaded cluster ID: a0f048c3ad03482e99d22bfc404ede58
I20260809 12:03:46.572341 11327 catalog_manager.cc:1552] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835: loading cluster ID for follower catalog manager: success
I20260809 12:03:46.576619 11327 catalog_manager.cc:1574] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835: acquiring CA information for follower catalog manager: success
I20260809 12:03:46.579774 11327 catalog_manager.cc:1602] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 12:03:46.606603 11193 master_runner.cc:186] Error getting master registration for 127.8.15.124:33307: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111),
I20260809 12:03:46.614677 11193 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:03:46.620637 9763 heartbeater.cc:347] Connected to a master server at 127.8.15.126:45327
I20260809 12:03:46.624612 11245 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" instance_seqno: 1786277010606266) as {username='slave'} at 127.8.15.67:44579; Asking this server to re-register.
I20260809 12:03:46.625438 9763 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:46.627485 11244 ts_manager.cc:194] Registered new tserver with Master: e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:46.709877 11338 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:03:46.710072 11338 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:46.710777 11338 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:03:46.713976 10980 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:03:46.719135 11263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "061d8c3603f14343920d858e640b9dfd" candidate_term: 7 candidate_status { last_received { term: 6 index: 53 } } ignore_live_leader: false dest_uuid: "abee08c3147547cc8f3379b5fc437835" is_pre_election: true
I20260809 12:03:46.719969 11263 raft_consensus.cc:2454] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 061d8c3603f14343920d858e640b9dfd in term 5.
I20260809 12:03:46.720584 10978 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd, abee08c3147547cc8f3379b5fc437835; no voters: 1e38ce37027547efa06785b9247f59bc
I20260809 12:03:46.720906 11338 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260809 12:03:46.721048 11338 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:03:46.721153 11338 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 6 FOLLOWER]: Advancing to term 7
I20260809 12:03:46.723201 11338 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:46.724236 11338 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 7 election: Requested vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
I20260809 12:03:46.724408 11263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "061d8c3603f14343920d858e640b9dfd" candidate_term: 7 candidate_status { last_received { term: 6 index: 53 } } ignore_live_leader: false dest_uuid: "abee08c3147547cc8f3379b5fc437835"
I20260809 12:03:46.724624 11263 raft_consensus.cc:3037] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 5 FOLLOWER]: Advancing to term 7
W20260809 12:03:46.725471 10980 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:03:46.731884 11263 raft_consensus.cc:2454] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 061d8c3603f14343920d858e640b9dfd in term 7.
I20260809 12:03:46.732291 10978 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd, abee08c3147547cc8f3379b5fc437835; no voters: 1e38ce37027547efa06785b9247f59bc
I20260809 12:03:46.732605 11338 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 7 FOLLOWER]: Leader election won for term 7
I20260809 12:03:46.733100 11338 raft_consensus.cc:686] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 7 LEADER]: Becoming Leader. State: Replica: 061d8c3603f14343920d858e640b9dfd, State: Running, Role: LEADER
I20260809 12:03:46.733592 11338 consensus_queue.cc:237] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 6.53, Last appended by leader: 53, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:46.735790 11344 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 061d8c3603f14343920d858e640b9dfd. Latest consensus state: current_term: 7 leader_uuid: "061d8c3603f14343920d858e640b9dfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:46.736241 11344 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: This master's current role is: LEADER
I20260809 12:03:46.736989 11350 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 12:03:46.740513 11350 catalog_manager.cc:669] Loaded metadata for table default.table_da029d70439d48cc842a66906f93d903 [id=085a7a8b72ea4da2817e62d516fbcc38]
I20260809 12:03:46.741026 11350 catalog_manager.cc:669] Loaded metadata for table default.table_8ccd04aad0ba4f5480308b917eb8a12e [id=325c41115c9d4a16820f3f3e2c53ab6b]
I20260809 12:03:46.741431 11350 catalog_manager.cc:669] Loaded metadata for table default.table_e97f6ba8b3354e24926902268c43a5e3 [id=5239b7194cf944d881c8c4b6113b0dfa]
I20260809 12:03:46.741827 11350 catalog_manager.cc:669] Loaded metadata for table default.table_1692567d64f8469c8550ff24a79d3e57 [id=560f9d6ae1904b3ba73a0b3ed65fddbe]
I20260809 12:03:46.742204 11350 catalog_manager.cc:669] Loaded metadata for table default.table_22580336a00e422aab032707ca16836e [id=6999f70d421f4417b855c361afdebc21]
I20260809 12:03:46.742625 11350 catalog_manager.cc:669] Loaded metadata for table default.table_520e75ee39c74e6985dbd81c6f2e32f8 [id=78883a236d6b4026a725d3a3cc60dec1]
I20260809 12:03:46.743003 11350 catalog_manager.cc:669] Loaded metadata for table default.table_939805886d394093ad5a402efa777cb4 [id=87a2e7cf29fa4fdc8d5ea2173cdc1c2d]
I20260809 12:03:46.743422 11350 catalog_manager.cc:669] Loaded metadata for table default.table_22e16baa34234ab0a0b7841c1041884c [id=a090addd1b9f4126b16d72d49ac02669]
I20260809 12:03:46.743801 11350 catalog_manager.cc:669] Loaded metadata for table default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf]
I20260809 12:03:46.747056 11350 tablet_loader.cc:96] loaded metadata for tablet 1c975cc8e50c41eaa6e0512666fa3892 (table default.table_22580336a00e422aab032707ca16836e [id=6999f70d421f4417b855c361afdebc21])
I20260809 12:03:46.747598 11350 tablet_loader.cc:96] loaded metadata for tablet 2e2f427c244f4438bcbf26ef6f5bb0e6 (table default.table_939805886d394093ad5a402efa777cb4 [id=87a2e7cf29fa4fdc8d5ea2173cdc1c2d])
I20260809 12:03:46.748751 11350 tablet_loader.cc:96] loaded metadata for tablet 6186291190194276958873fba5011624 (table default.table_8ccd04aad0ba4f5480308b917eb8a12e [id=325c41115c9d4a16820f3f3e2c53ab6b])
I20260809 12:03:46.749284 11350 tablet_loader.cc:96] loaded metadata for tablet 6e51d6c18fd34cf29dd0ac00e81a4a8c (table default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf])
I20260809 12:03:46.749828 11350 tablet_loader.cc:96] loaded metadata for tablet 76a803b3bb8844068c58fd4fc8f57e37 (table default.table_e97f6ba8b3354e24926902268c43a5e3 [id=5239b7194cf944d881c8c4b6113b0dfa])
I20260809 12:03:46.750098 11350 tablet_loader.cc:96] loaded metadata for tablet 776e37328c3c4c5f8a3477300ef747fa (table default.table_22e16baa34234ab0a0b7841c1041884c [id=a090addd1b9f4126b16d72d49ac02669])
I20260809 12:03:46.751124 11350 tablet_loader.cc:96] loaded metadata for tablet d5f97f6d773e4d0a9485ecb0404d4ff7 (table default.table_520e75ee39c74e6985dbd81c6f2e32f8 [id=78883a236d6b4026a725d3a3cc60dec1])
I20260809 12:03:46.751653 11350 tablet_loader.cc:96] loaded metadata for tablet e35641497b3849a0b712234a243699da (table default.table_1692567d64f8469c8550ff24a79d3e57 [id=560f9d6ae1904b3ba73a0b3ed65fddbe])
I20260809 12:03:46.751897 11350 tablet_loader.cc:96] loaded metadata for tablet eb1084478c8043ce860c786130f25350 (table default.table_da029d70439d48cc842a66906f93d903 [id=085a7a8b72ea4da2817e62d516fbcc38])
I20260809 12:03:46.752357 11350 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 12:03:46.753396 11350 catalog_manager.cc:1259] Loaded cluster ID: a0f048c3ad03482e99d22bfc404ede58
I20260809 12:03:46.753479 11350 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 12:03:46.754794 11350 catalog_manager.cc:1504] Loading token signing keys...
I20260809 12:03:46.755831 11350 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: Loaded TSK: 0
I20260809 12:03:46.756666 11350 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 12:03:46.757753 11350 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260809 12:03:46.758667 11350 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: -1
I20260809 12:03:46.768704 9527 heartbeater.cc:347] Connected to a master server at 127.8.15.126:45327
I20260809 12:03:46.770242 11244 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" instance_seqno: 1786277009716171) as {username='slave'} at 127.8.15.66:42041; Asking this server to re-register.
I20260809 12:03:46.770845 9527 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:46.772217 11244 ts_manager.cc:194] Registered new tserver with Master: cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479)
I20260809 12:03:46.784677 9298 heartbeater.cc:347] Connected to a master server at 127.8.15.126:45327
I20260809 12:03:46.785830 11244 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" instance_seqno: 1786277008701240) as {username='slave'} at 127.8.15.65:46677; Asking this server to re-register.
I20260809 12:03:46.786339 9298 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:46.787712 11244 ts_manager.cc:194] Registered new tserver with Master: f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
F20260809 12:03:46.961678 11082 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 1): 1 CREATE_TABLE default.table_badbfc92917e45a5aa60e47244ae5ff5
*** Check failure stack trace: ***
@ 0x7fdd4486c9ad google::LogMessage::Fail() at ??:0
@ 0x7fdd4486f88a google::LogMessage::SendToLog() at ??:0
@ 0x7fdd4486c4de google::LogMessage::Flush() at ??:0
@ 0x7fdd4486c6d1 google::LogMessage::~LogMessage() at ??:0
@ 0x7fdd5a40aba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260809 12:03:46.974992 9640 tablet_service.cc:1514] Processing DeleteTablet for tablet c755c68ccba04ded80a352012364af5b with delete_type TABLET_DATA_DELETED (replaced by tablet ce8a862530c448fa9c6241462a998723) from {username='slave'} at 127.0.0.1:33764
I20260809 12:03:46.975767 11360 tablet_replica.cc:330] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1: stopping tablet replica
I20260809 12:03:46.975999 11360 raft_consensus.cc:2229] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 LEADER]: Raft consensus shutting down.
I20260809 12:03:46.976462 11360 raft_consensus.cc:2258] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 12:03:46.977123 11360 ts_tablet_manager.cc:1905] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7fdd5a409901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7fdd5a41066c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260809 12:03:46.985317 11360 ts_tablet_manager.cc:1918] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260809 12:03:46.985445 11360 log.cc:1196] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting WAL directory at /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/ts-2/wal/wals/c755c68ccba04ded80a352012364af5b
I20260809 12:03:46.985930 11360 ts_tablet_manager.cc:1939] T c755c68ccba04ded80a352012364af5b P e0b5e4c0505c4122ae1349ee4beb5bd1: Deleting consensus metadata
I20260809 12:03:46.987330 10979 catalog_manager.cc:4841] TS e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793): tablet c755c68ccba04ded80a352012364af5b (table default.table_939805886d394093ad5a402efa777cb4 [id=87a2e7cf29fa4fdc8d5ea2173cdc1c2d]) successfully deleted
@ 0x7fdd5a4104e9 std::_Function_handler<>::_M_invoke() at ??:0
I20260809 12:03:46.991001 11263 raft_consensus.cc:1261] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 7 FOLLOWER]: Refusing update from remote peer 061d8c3603f14343920d858e640b9dfd: Log matching property violated. Preceding OpId in replica: term: 5 index: 49. Preceding OpId from leader: term: 7 index: 55. (index mismatch)
W20260809 12:03:46.991412 10980 consensus_peers.cc:487] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd -> Peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Couldn't send request to peer 1e38ce37027547efa06785b9247f59bc. Status: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
@ 0x9edb7d std::function<>::operator()() at ??:?
I20260809 12:03:46.991988 11344 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 54, Last known committed idx: 49, Time since last communication: 0.000s
@ 0x7fdd47496eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fdd4a7706db start_thread at ??:0
@ 0x7fdd4370661f clone at ??:0
I20260809 12:03:47.004990 11308 sys_catalog.cc:455] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 061d8c3603f14343920d858e640b9dfd. Latest consensus state: current_term: 7 leader_uuid: "061d8c3603f14343920d858e640b9dfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:47.004937 11374 sys_catalog.cc:455] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "061d8c3603f14343920d858e640b9dfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:47.005345 11308 sys_catalog.cc:458] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:47.005406 11374 sys_catalog.cc:458] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:47.006111 11370 mvcc.cc:205] Tried to move back new op lower bound from 7316590690852569088 to 7316590690483187712. Current Snapshot: MvccSnapshot[applied={T|T < 7316590690852569088 or (T in {7316590690852569088})}]
I20260809 12:03:47.049933 9766 heartbeater.cc:503] Master 127.8.15.125:37165 was elected leader, sending a full tablet report...
W20260809 12:03:47.167512 9571 connection.cc:535] client connection to 127.8.15.125:37165 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:47.167488 11228 connection.cc:535] server connection from 127.0.0.1:38828 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 12:03:47.281517 9530 heartbeater.cc:503] Master 127.8.15.125:37165 was elected leader, sending a full tablet report...
I20260809 12:03:47.315668 9308 heartbeater.cc:503] Master 127.8.15.125:37165 was elected leader, sending a full tablet report...
I20260809 12:03:47.495016 11374 raft_consensus.cc:482] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 061d8c3603f14343920d858e640b9dfd)
I20260809 12:03:47.495252 11374 raft_consensus.cc:504] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:47.497370 11374 leader_election.cc:288] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:03:47.498541 11224 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
W20260809 12:03:47.500535 11224 leader_election.cc:334] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
W20260809 12:03:47.500801 11229 leader_election.cc:334] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:03:47.500941 11229 leader_election.cc:302] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abee08c3147547cc8f3379b5fc437835; no voters: 061d8c3603f14343920d858e640b9dfd, 1e38ce37027547efa06785b9247f59bc
I20260809 12:03:47.501317 11374 raft_consensus.cc:2726] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260809 12:03:48.117363 11397 raft_consensus.cc:482] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 061d8c3603f14343920d858e640b9dfd)
I20260809 12:03:48.117573 11397 raft_consensus.cc:504] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:48.118279 11397 leader_election.cc:288] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:03:48.120251 11224 leader_election.cc:334] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
W20260809 12:03:48.120430 11229 leader_election.cc:334] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:03:48.120559 11229 leader_election.cc:302] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abee08c3147547cc8f3379b5fc437835; no voters: 061d8c3603f14343920d858e640b9dfd, 1e38ce37027547efa06785b9247f59bc
I20260809 12:03:48.120826 11397 raft_consensus.cc:2726] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260809 12:03:48.978876 11418 raft_consensus.cc:482] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 061d8c3603f14343920d858e640b9dfd)
I20260809 12:03:48.979135 11418 raft_consensus.cc:504] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:48.979782 11418 leader_election.cc:288] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:03:48.981698 11229 leader_election.cc:334] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
W20260809 12:03:48.981833 11224 leader_election.cc:334] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
I20260809 12:03:48.982008 11224 leader_election.cc:302] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abee08c3147547cc8f3379b5fc437835; no voters: 061d8c3603f14343920d858e640b9dfd, 1e38ce37027547efa06785b9247f59bc
I20260809 12:03:48.982265 11418 raft_consensus.cc:2726] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260809 12:03:49.520298 11430 raft_consensus.cc:482] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 061d8c3603f14343920d858e640b9dfd)
I20260809 12:03:49.520517 11430 raft_consensus.cc:504] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:49.521162 11430 leader_election.cc:288] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:03:49.523150 11229 leader_election.cc:334] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
W20260809 12:03:49.523393 11224 leader_election.cc:334] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
I20260809 12:03:49.523554 11224 leader_election.cc:302] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abee08c3147547cc8f3379b5fc437835; no voters: 061d8c3603f14343920d858e640b9dfd, 1e38ce37027547efa06785b9247f59bc
I20260809 12:03:49.523782 11430 raft_consensus.cc:2726] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260809 12:03:49.593768 8253 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
/tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.15.124:33307
--webserver_interface=127.8.15.124
--webserver_port=44863
--builtin_ntp_servers=127.8.15.84:46271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--hive_metastore_uris=thrift://127.0.0.1:44923
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260809 12:03:49.940696 11434 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 12:03:49.940973 11434 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 12:03:49.941089 11434 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 12:03:49.948313 11434 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 12:03:49.948421 11434 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 12:03:49.948475 11434 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 12:03:49.948561 11434 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 12:03:49.957798 11434 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.15.84:46271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:44923
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.15.124:33307
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.15.124
--webserver_port=44863
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:06:41 UTC on ccycloud.quasar-bwoogy.root.comops.site
build id 4575991
ASAN enabled
I20260809 12:03:49.959226 11434 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 12:03:49.961050 11434 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 12:03:49.973503 11445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:49.973562 11447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:49.973686 11444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 12:03:49.974201 11434 server_base.cc:1034] running on GCE node
I20260809 12:03:49.975055 11434 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 12:03:49.976542 11434 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 12:03:49.977754 11434 hybrid_clock.cc:648] HybridClock initialized: now 1786277029977682 us; error 55 us; skew 500 ppm
I20260809 12:03:49.978073 11434 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 12:03:49.984321 11434 webserver.cc:460] Webserver started at http://127.8.15.124:44863/ using document root <none> and password file <none>
I20260809 12:03:49.985059 11434 fs_manager.cc:359] Metadata directory not provided
I20260809 12:03:49.985186 11434 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 12:03:49.990859 11434 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 12:03:49.993868 11457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 12:03:49.995195 11434 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 12:03:49.995393 11434 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data,/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/wal
uuid: "1e38ce37027547efa06785b9247f59bc"
format_stamp: "Formatted at 2026-08-09 12:03:27 on dist-test-slave-21b9"
I20260809 12:03:49.996341 11434 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 12:03:50.019618 11434 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 12:03:50.020533 11434 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 12:03:50.020816 11434 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 12:03:50.040616 11434 rpc_server.cc:307] RPC server started. Bound to: 127.8.15.124:33307
I20260809 12:03:50.040637 11536 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.15.124:33307 every 8 connection(s)
I20260809 12:03:50.042171 11434 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data/info.pb
I20260809 12:03:50.044669 8253 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu as pid 11434
I20260809 12:03:50.049985 11539 sys_catalog.cc:263] Verifying existing consensus state
I20260809 12:03:50.053624 11539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: Bootstrap starting.
I20260809 12:03:50.065848 11539 log.cc:824] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: Log is configured to *not* fsync() on all Append() calls
I20260809 12:03:50.104892 11539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: Bootstrap replayed 1/1 log segments. Stats: ops{read=53 overwritten=0 applied=50 ignored=0} inserts{seen=35 ignored=0} mutations{seen=41 ignored=0} orphaned_commits=0. Pending: 3 replicates
I20260809 12:03:50.105561 11539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: Bootstrap complete.
I20260809 12:03:50.113508 11539 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 6 FOLLOWER]: Replica starting. Triggering 3 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:50.117126 11539 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e38ce37027547efa06785b9247f59bc, State: Initialized, Role: FOLLOWER
I20260809 12:03:50.117830 11539 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 50, Last appended: 6.53, Last appended by leader: 53, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:50.118610 11544 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:50.118919 11544 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:50.119782 11539 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 12:03:50.137305 11565 catalog_manager.cc:1259] Loaded cluster ID: a0f048c3ad03482e99d22bfc404ede58
I20260809 12:03:50.137428 11565 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: loading cluster ID for follower catalog manager: success
I20260809 12:03:50.141637 11565 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: acquiring CA information for follower catalog manager: success
I20260809 12:03:50.145570 11565 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 12:03:50.159520 11434 master_runner.cc:186] Error getting master registration for 127.8.15.125:37165: Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111),
I20260809 12:03:50.166196 11434 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:03:50.172500 11428 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:03:50.172704 11428 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:50.173530 11428 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:03:50.174510 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:03:50.174710 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:03:50.174875 9571 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:03:50.175145 11428 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 12:03:50.304540 9765 heartbeater.cc:347] Connected to a master server at 127.8.15.124:33307
I20260809 12:03:50.308012 11483 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" instance_seqno: 1786277010606266) as {username='slave'} at 127.8.15.67:38841; Asking this server to re-register.
I20260809 12:03:50.308688 9765 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:50.310405 11483 ts_manager.cc:194] Registered new tserver with Master: e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:50.357501 9529 heartbeater.cc:347] Connected to a master server at 127.8.15.124:33307
I20260809 12:03:50.358662 9300 heartbeater.cc:347] Connected to a master server at 127.8.15.124:33307
I20260809 12:03:50.359112 11482 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" instance_seqno: 1786277009716171) as {username='slave'} at 127.8.15.66:35475; Asking this server to re-register.
I20260809 12:03:50.359805 9529 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:50.359965 11482 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" instance_seqno: 1786277008701240) as {username='slave'} at 127.8.15.65:42907; Asking this server to re-register.
I20260809 12:03:50.360545 9300 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:50.361443 11482 ts_manager.cc:194] Registered new tserver with Master: cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479)
I20260809 12:03:50.361948 11483 ts_manager.cc:194] Registered new tserver with Master: f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
I20260809 12:03:50.628180 11578 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:50.628476 11578 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:50.630466 11578 leader_election.cc:288] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165)
I20260809 12:03:50.631062 11263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e38ce37027547efa06785b9247f59bc" candidate_term: 7 candidate_status { last_received { term: 6 index: 53 } } ignore_live_leader: false dest_uuid: "abee08c3147547cc8f3379b5fc437835" is_pre_election: true
W20260809 12:03:50.631183 11458 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
I20260809 12:03:50.631412 11263 raft_consensus.cc:2379] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e38ce37027547efa06785b9247f59bc in current term 7: Already voted for candidate 061d8c3603f14343920d858e640b9dfd in this term.
W20260809 12:03:50.632763 11458 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
I20260809 12:03:50.632970 11458 leader_election.cc:302] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e38ce37027547efa06785b9247f59bc; no voters: 061d8c3603f14343920d858e640b9dfd, abee08c3147547cc8f3379b5fc437835
I20260809 12:03:50.633373 11578 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 6 FOLLOWER]: Advancing to term 7
I20260809 12:03:50.637717 11578 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260809 12:03:51.349606 11586 raft_consensus.cc:482] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 061d8c3603f14343920d858e640b9dfd)
I20260809 12:03:51.349851 11586 raft_consensus.cc:504] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:51.350618 11586 leader_election.cc:288] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:03:51.354754 11224 leader_election.cc:334] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
I20260809 12:03:51.359149 11498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "abee08c3147547cc8f3379b5fc437835" candidate_term: 8 candidate_status { last_received { term: 7 index: 55 } } ignore_live_leader: false dest_uuid: "1e38ce37027547efa06785b9247f59bc" is_pre_election: true
I20260809 12:03:51.359697 11498 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abee08c3147547cc8f3379b5fc437835 in term 7.
I20260809 12:03:51.360216 11229 leader_election.cc:302] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835; no voters: 061d8c3603f14343920d858e640b9dfd
I20260809 12:03:51.360517 11586 raft_consensus.cc:2781] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260809 12:03:51.360632 11586 raft_consensus.cc:482] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 061d8c3603f14343920d858e640b9dfd)
I20260809 12:03:51.360723 11586 raft_consensus.cc:3037] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 7 FOLLOWER]: Advancing to term 8
I20260809 12:03:51.362792 11586 raft_consensus.cc:504] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:51.363438 11586 leader_election.cc:288] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 8 election: Requested vote from peers 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
I20260809 12:03:51.363997 11498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "abee08c3147547cc8f3379b5fc437835" candidate_term: 8 candidate_status { last_received { term: 7 index: 55 } } ignore_live_leader: false dest_uuid: "1e38ce37027547efa06785b9247f59bc"
I20260809 12:03:51.364228 11498 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 7 FOLLOWER]: Advancing to term 8
W20260809 12:03:51.364662 11224 leader_election.cc:334] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
I20260809 12:03:51.366600 11498 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abee08c3147547cc8f3379b5fc437835 in term 8.
I20260809 12:03:51.366995 11229 leader_election.cc:302] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835; no voters: 061d8c3603f14343920d858e640b9dfd
I20260809 12:03:51.367291 11586 raft_consensus.cc:2781] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 8 FOLLOWER]: Leader election won for term 8
I20260809 12:03:51.367934 11586 raft_consensus.cc:686] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [term 8 LEADER]: Becoming Leader. State: Replica: abee08c3147547cc8f3379b5fc437835, State: Running, Role: LEADER
I20260809 12:03:51.368383 11586 consensus_queue.cc:237] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 7.55, Last appended by leader: 55, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:51.370209 11593 sys_catalog.cc:455] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: SysCatalogTable state changed. Reason: New leader abee08c3147547cc8f3379b5fc437835. Latest consensus state: current_term: 8 leader_uuid: "abee08c3147547cc8f3379b5fc437835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:51.370505 11593 sys_catalog.cc:458] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: This master's current role is: LEADER
I20260809 12:03:51.617167 11193 master_runner.cc:186] Error getting master registration for 127.8.15.125:37165: Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111),
I20260809 12:03:51.617345 11193 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:03:51.723697 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 11: this message will repeat every 5th retry.
W20260809 12:03:51.840483 11224 consensus_peers.cc:487] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 -> Peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Couldn't send request to peer 061d8c3603f14343920d858e640b9dfd. Status: Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 12:03:51.889092 11498 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Refusing update from remote peer abee08c3147547cc8f3379b5fc437835: Log matching property violated. Preceding OpId in replica: term: 6 index: 53. Preceding OpId from leader: term: 8 index: 56. (index mismatch)
I20260809 12:03:51.889905 11593 consensus_queue.cc:1035] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 56, Last known committed idx: 50, Time since last communication: 0.000s
I20260809 12:03:51.895138 11606 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader abee08c3147547cc8f3379b5fc437835. Latest consensus state: current_term: 8 leader_uuid: "abee08c3147547cc8f3379b5fc437835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:51.895498 11606 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:51.897801 11606 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "abee08c3147547cc8f3379b5fc437835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:51.898064 11606 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:51.898536 11618 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "abee08c3147547cc8f3379b5fc437835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:51.899017 11618 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:51.899433 11593 sys_catalog.cc:455] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "abee08c3147547cc8f3379b5fc437835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:51.899787 11593 sys_catalog.cc:458] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: This master's current role is: LEADER
I20260809 12:03:51.899609 11614 sys_catalog.cc:455] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 8 leader_uuid: "abee08c3147547cc8f3379b5fc437835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:51.899935 11614 sys_catalog.cc:458] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835 [sys.catalog]: This master's current role is: LEADER
I20260809 12:03:52.015776 11597 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 12:03:52.019068 11597 catalog_manager.cc:669] Loaded metadata for table default.table_da029d70439d48cc842a66906f93d903 [id=085a7a8b72ea4da2817e62d516fbcc38]
I20260809 12:03:52.019634 11597 catalog_manager.cc:669] Loaded metadata for table default.table_8ccd04aad0ba4f5480308b917eb8a12e [id=325c41115c9d4a16820f3f3e2c53ab6b]
I20260809 12:03:52.020007 11597 catalog_manager.cc:669] Loaded metadata for table default.table_e97f6ba8b3354e24926902268c43a5e3 [id=5239b7194cf944d881c8c4b6113b0dfa]
I20260809 12:03:52.020294 11597 catalog_manager.cc:669] Loaded metadata for table default.table_1692567d64f8469c8550ff24a79d3e57 [id=560f9d6ae1904b3ba73a0b3ed65fddbe]
I20260809 12:03:52.020563 11597 catalog_manager.cc:669] Loaded metadata for table default.table_22580336a00e422aab032707ca16836e [id=6999f70d421f4417b855c361afdebc21]
I20260809 12:03:52.020949 11597 catalog_manager.cc:669] Loaded metadata for table default.table_520e75ee39c74e6985dbd81c6f2e32f8 [id=78883a236d6b4026a725d3a3cc60dec1]
I20260809 12:03:52.021222 11597 catalog_manager.cc:669] Loaded metadata for table default.table_939805886d394093ad5a402efa777cb4 [id=87a2e7cf29fa4fdc8d5ea2173cdc1c2d]
I20260809 12:03:52.021498 11597 catalog_manager.cc:669] Loaded metadata for table default.table_22e16baa34234ab0a0b7841c1041884c [id=a090addd1b9f4126b16d72d49ac02669]
I20260809 12:03:52.021749 11597 catalog_manager.cc:669] Loaded metadata for table default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf]
I20260809 12:03:52.024148 11597 tablet_loader.cc:96] loaded metadata for tablet 1c975cc8e50c41eaa6e0512666fa3892 (table default.table_22580336a00e422aab032707ca16836e [id=6999f70d421f4417b855c361afdebc21])
I20260809 12:03:52.024567 11597 tablet_loader.cc:96] loaded metadata for tablet 2e2f427c244f4438bcbf26ef6f5bb0e6 (table default.table_939805886d394093ad5a402efa777cb4 [id=87a2e7cf29fa4fdc8d5ea2173cdc1c2d])
I20260809 12:03:52.025249 11597 tablet_loader.cc:96] loaded metadata for tablet 6186291190194276958873fba5011624 (table default.table_8ccd04aad0ba4f5480308b917eb8a12e [id=325c41115c9d4a16820f3f3e2c53ab6b])
I20260809 12:03:52.025594 11597 tablet_loader.cc:96] loaded metadata for tablet 6e51d6c18fd34cf29dd0ac00e81a4a8c (table default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf])
I20260809 12:03:52.025954 11597 tablet_loader.cc:96] loaded metadata for tablet 76a803b3bb8844068c58fd4fc8f57e37 (table default.table_e97f6ba8b3354e24926902268c43a5e3 [id=5239b7194cf944d881c8c4b6113b0dfa])
I20260809 12:03:52.026167 11597 tablet_loader.cc:96] loaded metadata for tablet 776e37328c3c4c5f8a3477300ef747fa (table default.table_22e16baa34234ab0a0b7841c1041884c [id=a090addd1b9f4126b16d72d49ac02669])
I20260809 12:03:52.027021 11597 tablet_loader.cc:96] loaded metadata for tablet d5f97f6d773e4d0a9485ecb0404d4ff7 (table default.table_520e75ee39c74e6985dbd81c6f2e32f8 [id=78883a236d6b4026a725d3a3cc60dec1])
I20260809 12:03:52.027449 11597 tablet_loader.cc:96] loaded metadata for tablet e35641497b3849a0b712234a243699da (table default.table_1692567d64f8469c8550ff24a79d3e57 [id=560f9d6ae1904b3ba73a0b3ed65fddbe])
I20260809 12:03:52.027698 11597 tablet_loader.cc:96] loaded metadata for tablet eb1084478c8043ce860c786130f25350 (table default.table_da029d70439d48cc842a66906f93d903 [id=085a7a8b72ea4da2817e62d516fbcc38])
I20260809 12:03:52.028077 11597 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 12:03:52.029140 11597 catalog_manager.cc:1259] Loaded cluster ID: a0f048c3ad03482e99d22bfc404ede58
I20260809 12:03:52.029215 11597 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 12:03:52.030721 11597 catalog_manager.cc:1504] Loading token signing keys...
I20260809 12:03:52.031804 11597 catalog_manager.cc:5879] T 00000000000000000000000000000000 P abee08c3147547cc8f3379b5fc437835: Loaded TSK: 0
I20260809 12:03:52.032665 11597 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 12:03:52.033653 11597 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260809 12:03:52.034570 11597 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: -1
I20260809 12:03:52.049654 11245 master_service.cc:946] ReplaceTablet: received request to replace tablet 85bb8662f3174951bbdb45c8fcbaa975 from {username='slave'} at 127.0.0.1:38810
I20260809 12:03:52.050711 11235 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38810:
table { table_name: "default.Table_22580336a00e422aab032707ca16836e" } modify_external_catalogs: true
I20260809 12:03:52.051072 11235 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38810:
table { table_name: "default.Table_22580336a00e422aab032707ca16836e" } modify_external_catalogs: true
I20260809 12:03:52.051298 11244 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38810:
name: "default.Table_98748f90a4da4969b9f519b8b02d21a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:52.052256 11243 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38810:
table { table_name: "default.Table_1692567d64f8469c8550ff24a79d3e57" } new_table_name: "default.Table_e53628efaa614b888fbce28b06e96b27" modify_external_catalogs: true
I20260809 12:03:52.052407 11233 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38810:
table { table_name: "default.Table_22e16baa34234ab0a0b7841c1041884c" } modify_external_catalogs: true
I20260809 12:03:52.052685 11233 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38810:
table { table_name: "default.Table_22e16baa34234ab0a0b7841c1041884c" } modify_external_catalogs: true
I20260809 12:03:52.053067 11245 master_service.cc:946] ReplaceTablet: received request to replace tablet 67e9ded6eae9402a873f21c7219fed24 from {username='slave'} at 127.0.0.1:38810
I20260809 12:03:52.052914 11234 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38810:
name: "default.Table_20e68010fb344d51ae82c39f2a5b6520"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:52.052964 11242 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38810:
name: "default.Table_32063c5c554f4148b27ed449777518f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:52.053551 11245 master_service.cc:946] ReplaceTablet: received request to replace tablet f2b1d869fa714372bb2bdce7e9bcdfa8 from {username='slave'} at 127.0.0.1:38810
I20260809 12:03:52.053692 11236 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38810:
name: "default.Table_23a7e0a1a33a491ea66728c96d558eef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:52.054651 11238 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38810:
name: "default.Table_423f03903e0a49bca52f545faad63055"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 12:03:52.055148 11245 master_service.cc:946] ReplaceTablet: received request to replace tablet 67e9ded6eae9402a873f21c7219fed24 from {username='slave'} at 127.0.0.1:38810
I20260809 12:03:52.055017 11239 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38810:
table { table_name: "default.Table_5e7b5144853246789d8fc5da01626dc7" } new_table_name: "default.Table_c9c43a2a0d1a4e209f094445b8de091c" modify_external_catalogs: true
I20260809 12:03:52.055756 11245 master_service.cc:946] ReplaceTablet: received request to replace tablet d8214eed04f14bd5bbe3a79b549fa71c from {username='slave'} at 127.0.0.1:38810
I20260809 12:03:52.056330 11245 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38810:
name: "default.Table_ae991ee631804400852a07ac513507b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
F20260809 12:03:52.058589 11326 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 1): 1 CREATE_TABLE default.table_badbfc92917e45a5aa60e47244ae5ff5
*** Check failure stack trace: ***
@ 0x7f72f094d9ad google::LogMessage::Fail() at ??:0
@ 0x7f72f095088a google::LogMessage::SendToLog() at ??:0
@ 0x7f72f094d4de google::LogMessage::Flush() at ??:0
@ 0x7f72f094d6d1 google::LogMessage::~LogMessage() at ??:0
@ 0x7f73064ebba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f73064ea901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7f73064f166c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7f73064f14e9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f72f3577eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f72f68516db start_thread at ??:0
@ 0x7f72ef7e761f clone at ??:0
W20260809 12:03:52.249917 9573 connection.cc:535] client connection to 127.8.15.126:45327 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:52.250777 9780 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.8.15.126:45327)
W20260809 12:03:52.251171 9780 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.8.15.126:45327)
W20260809 12:03:52.251490 9780 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.8.15.126:45327)
W20260809 12:03:52.257824 9780 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.8.15.126:45327)
I20260809 12:03:52.398231 11618 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader abee08c3147547cc8f3379b5fc437835)
I20260809 12:03:52.398471 11618 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:52.399158 11618 leader_election.cc:288] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165)
W20260809 12:03:52.401238 11458 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
W20260809 12:03:52.401424 11460 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:03:52.401535 11460 leader_election.cc:302] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e38ce37027547efa06785b9247f59bc; no voters: 061d8c3603f14343920d858e640b9dfd, abee08c3147547cc8f3379b5fc437835
I20260809 12:03:52.401741 11618 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260809 12:03:52.521401 8253 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu pid 11434
I20260809 12:03:52.528702 11528 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 12:03:52.639106 8253 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu with pid 11434
W20260809 12:03:52.667368 9782 connection.cc:535] client connection to 127.8.15.124:33307 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:53.243407 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 11: this message will repeat every 5th retry.
I20260809 12:03:53.302827 8253 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
/tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.15.124:33307
--webserver_interface=127.8.15.124
--webserver_port=44863
--builtin_ntp_servers=127.8.15.84:46271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--hive_metastore_uris=thrift://127.0.0.1:44923
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260809 12:03:53.652757 11673 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 12:03:53.653069 11673 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 12:03:53.653160 11673 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 12:03:53.660955 11673 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 12:03:53.661082 11673 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 12:03:53.661137 11673 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 12:03:53.661201 11673 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 12:03:53.670699 11673 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.15.84:46271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:44923
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.15.124:33307
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.15.124
--webserver_port=44863
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:06:41 UTC on ccycloud.quasar-bwoogy.root.comops.site
build id 4575991
ASAN enabled
I20260809 12:03:53.672195 11673 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 12:03:53.674077 11673 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 12:03:53.686242 11684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:53.686211 11688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:53.686223 11683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 12:03:53.687031 11673 server_base.cc:1034] running on GCE node
I20260809 12:03:53.687891 11673 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 12:03:53.689352 11673 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 12:03:53.690595 11673 hybrid_clock.cc:648] HybridClock initialized: now 1786277033690521 us; error 48 us; skew 500 ppm
I20260809 12:03:53.690935 11673 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 12:03:53.693269 11673 webserver.cc:460] Webserver started at http://127.8.15.124:44863/ using document root <none> and password file <none>
I20260809 12:03:53.693984 11673 fs_manager.cc:359] Metadata directory not provided
I20260809 12:03:53.694115 11673 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 12:03:53.699584 11673 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 12:03:53.702618 11695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 12:03:53.704090 11673 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 12:03:53.704273 11673 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data,/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/wal
uuid: "1e38ce37027547efa06785b9247f59bc"
format_stamp: "Formatted at 2026-08-09 12:03:27 on dist-test-slave-21b9"
I20260809 12:03:53.705281 11673 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 12:03:53.734876 11673 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 12:03:53.735817 11673 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 12:03:53.736104 11673 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 12:03:53.753585 11673 rpc_server.cc:307] RPC server started. Bound to: 127.8.15.124:33307
I20260809 12:03:53.753604 11771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.15.124:33307 every 8 connection(s)
I20260809 12:03:53.755541 11673 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data/info.pb
I20260809 12:03:53.763125 11772 sys_catalog.cc:263] Verifying existing consensus state
I20260809 12:03:53.764678 8253 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu as pid 11673
I20260809 12:03:53.768049 11772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: Bootstrap starting.
I20260809 12:03:53.784438 11772 log.cc:824] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: Log is configured to *not* fsync() on all Append() calls
I20260809 12:03:53.825989 11772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: Bootstrap replayed 1/1 log segments. Stats: ops{read=56 overwritten=0 applied=56 ignored=0} inserts{seen=38 ignored=0} mutations{seen=51 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 12:03:53.826524 11772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: Bootstrap complete.
I20260809 12:03:53.834760 11772 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:53.835688 11772 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e38ce37027547efa06785b9247f59bc, State: Initialized, Role: FOLLOWER
I20260809 12:03:53.836304 11772 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 56, Last appended: 8.56, Last appended by leader: 56, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:53.837064 11783 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:53.837376 11783 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:53.838095 11772 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 12:03:53.849400 11805 catalog_manager.cc:1259] Loaded cluster ID: a0f048c3ad03482e99d22bfc404ede58
I20260809 12:03:53.849514 11805 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: loading cluster ID for follower catalog manager: success
I20260809 12:03:53.854082 11805 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: acquiring CA information for follower catalog manager: success
I20260809 12:03:53.847649 11673 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:03:53.856698 11673 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:03:53.857339 11805 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 12:03:53.883786 9300 heartbeater.cc:347] Connected to a master server at 127.8.15.124:33307
I20260809 12:03:53.884246 9529 heartbeater.cc:347] Connected to a master server at 127.8.15.124:33307
I20260809 12:03:53.887360 11725 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" instance_seqno: 1786277008701240) as {username='slave'} at 127.8.15.65:34079; Asking this server to re-register.
I20260809 12:03:53.887383 11723 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" instance_seqno: 1786277009716171) as {username='slave'} at 127.8.15.66:34463; Asking this server to re-register.
I20260809 12:03:53.888280 9300 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:53.888356 9529 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:53.889978 11725 ts_manager.cc:194] Registered new tserver with Master: f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
I20260809 12:03:53.890098 11723 ts_manager.cc:194] Registered new tserver with Master: cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479)
I20260809 12:03:54.214733 9765 heartbeater.cc:347] Connected to a master server at 127.8.15.124:33307
I20260809 12:03:54.216413 11725 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" instance_seqno: 1786277010606266) as {username='slave'} at 127.8.15.67:57177; Asking this server to re-register.
I20260809 12:03:54.216945 9765 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:54.218096 11725 ts_manager.cc:194] Registered new tserver with Master: e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:54.350004 11820 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:54.350282 11820 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:54.352195 11820 leader_election.cc:288] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165)
W20260809 12:03:54.352999 11698 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:03:54.354542 11698 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:03:54.354758 11697 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
I20260809 12:03:54.354892 11697 leader_election.cc:302] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e38ce37027547efa06785b9247f59bc; no voters: 061d8c3603f14343920d858e640b9dfd, abee08c3147547cc8f3379b5fc437835
I20260809 12:03:54.355228 11820 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260809 12:03:54.929746 11828 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:54.929968 11828 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:54.930634 11828 leader_election.cc:288] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165)
W20260809 12:03:54.932984 11698 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:03:54.933173 11697 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
I20260809 12:03:54.933292 11697 leader_election.cc:302] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e38ce37027547efa06785b9247f59bc; no voters: 061d8c3603f14343920d858e640b9dfd, abee08c3147547cc8f3379b5fc437835
I20260809 12:03:54.933540 11828 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260809 12:03:55.442917 11846 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:55.443176 11846 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:55.443850 11846 leader_election.cc:288] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165)
W20260809 12:03:55.445842 11698 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:03:55.446010 11697 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
I20260809 12:03:55.446137 11697 leader_election.cc:302] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e38ce37027547efa06785b9247f59bc; no voters: 061d8c3603f14343920d858e640b9dfd, abee08c3147547cc8f3379b5fc437835
I20260809 12:03:55.446376 11846 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260809 12:03:56.259904 8253 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu pid 11673
I20260809 12:03:56.270449 11767 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 12:03:56.378707 8253 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu with pid 11673
W20260809 12:03:56.406486 9128 connection.cc:535] client connection to 127.8.15.124:33307 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:03:56.406924 9352 connection.cc:535] client connection to 127.8.15.124:33307 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 12:03:57.003433 8253 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
/tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.15.124:33307
--webserver_interface=127.8.15.124
--webserver_port=44863
--builtin_ntp_servers=127.8.15.84:46271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--hive_metastore_uris=thrift://127.0.0.1:44923
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260809 12:03:57.282505 11882 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:03:57.282722 11882 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:03:57.283531 11882 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:03:57.284327 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:03:57.284524 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:03:57.284655 9573 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:03:57.284914 11882 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260809 12:03:57.351672 11881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 12:03:57.351992 11881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 12:03:57.352079 11881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 12:03:57.359329 11881 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 12:03:57.359443 11881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 12:03:57.359493 11881 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 12:03:57.359546 11881 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 12:03:57.368841 11881 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.15.84:46271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:44923
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.15.124:33307
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.15.124
--webserver_port=44863
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:06:41 UTC on ccycloud.quasar-bwoogy.root.comops.site
build id 4575991
ASAN enabled
I20260809 12:03:57.370721 11881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 12:03:57.372725 11881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 12:03:57.384302 11892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:57.384409 11893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:03:57.384434 11895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 12:03:57.385273 11881 server_base.cc:1034] running on GCE node
I20260809 12:03:57.386076 11881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 12:03:57.387581 11881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 12:03:57.388841 11881 hybrid_clock.cc:648] HybridClock initialized: now 1786277037388764 us; error 47 us; skew 500 ppm
I20260809 12:03:57.389191 11881 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 12:03:57.391440 11881 webserver.cc:460] Webserver started at http://127.8.15.124:44863/ using document root <none> and password file <none>
I20260809 12:03:57.392141 11881 fs_manager.cc:359] Metadata directory not provided
I20260809 12:03:57.392261 11881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 12:03:57.397409 11881 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260809 12:03:57.400321 11902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 12:03:57.401618 11881 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 12:03:57.401790 11881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data,/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/wal
uuid: "1e38ce37027547efa06785b9247f59bc"
format_stamp: "Formatted at 2026-08-09 12:03:27 on dist-test-slave-21b9"
I20260809 12:03:57.402719 11881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 12:03:57.415400 11881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 12:03:57.416182 11881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 12:03:57.416433 11881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 12:03:57.433460 11881 rpc_server.cc:307] RPC server started. Bound to: 127.8.15.124:33307
I20260809 12:03:57.433477 11982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.15.124:33307 every 8 connection(s)
I20260809 12:03:57.435009 11881 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-2/data/info.pb
I20260809 12:03:57.435357 8253 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu as pid 11881
I20260809 12:03:57.443958 11983 sys_catalog.cc:263] Verifying existing consensus state
I20260809 12:03:57.448228 11983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: Bootstrap starting.
I20260809 12:03:57.460937 9765 heartbeater.cc:347] Connected to a master server at 127.8.15.124:33307
I20260809 12:03:57.465157 11983 log.cc:824] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: Log is configured to *not* fsync() on all Append() calls
I20260809 12:03:57.506839 11983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: Bootstrap replayed 1/1 log segments. Stats: ops{read=56 overwritten=0 applied=56 ignored=0} inserts{seen=38 ignored=0} mutations{seen=51 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 12:03:57.507449 11983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: Bootstrap complete.
I20260809 12:03:57.515072 11983 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:57.515988 11983 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e38ce37027547efa06785b9247f59bc, State: Initialized, Role: FOLLOWER
I20260809 12:03:57.516597 11983 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 56, Last appended: 8.56, Last appended by leader: 56, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:57.517383 11993 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:03:57.517706 11993 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:03:57.518414 11983 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 12:03:57.529409 12018 catalog_manager.cc:1259] Loaded cluster ID: a0f048c3ad03482e99d22bfc404ede58
I20260809 12:03:57.529561 12018 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: loading cluster ID for follower catalog manager: success
I20260809 12:03:57.534102 12018 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: acquiring CA information for follower catalog manager: success
I20260809 12:03:57.537182 12018 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 12:03:57.538481 11881 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:03:57.547871 11881 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:03:57.916481 9529 heartbeater.cc:347] Connected to a master server at 127.8.15.124:33307
I20260809 12:03:57.916528 9300 heartbeater.cc:347] Connected to a master server at 127.8.15.124:33307
I20260809 12:03:57.918725 11930 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" instance_seqno: 1786277008701240) as {username='slave'} at 127.8.15.65:59893; Asking this server to re-register.
I20260809 12:03:57.918747 11928 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" instance_seqno: 1786277009716171) as {username='slave'} at 127.8.15.66:54807; Asking this server to re-register.
I20260809 12:03:57.919411 9529 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:57.919510 9300 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:57.921200 11930 ts_manager.cc:194] Registered new tserver with Master: f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
I20260809 12:03:57.921330 11928 ts_manager.cc:194] Registered new tserver with Master: cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479)
I20260809 12:03:57.965020 11930 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" instance_seqno: 1786277010606266) as {username='slave'} at 127.8.15.67:56951; Asking this server to re-register.
I20260809 12:03:57.965647 9765 heartbeater.cc:464] Registering TS with master...
I20260809 12:03:57.966952 11930 ts_manager.cc:194] Registered new tserver with Master: e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:03:58.104511 12024 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:58.104779 12024 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:58.106702 12024 leader_election.cc:288] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165)
W20260809 12:03:58.107638 11904 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:03:58.108888 11904 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:03:58.109102 11903 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
I20260809 12:03:58.109242 11903 leader_election.cc:302] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e38ce37027547efa06785b9247f59bc; no voters: 061d8c3603f14343920d858e640b9dfd, abee08c3147547cc8f3379b5fc437835
I20260809 12:03:58.109635 12024 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260809 12:03:58.820590 12047 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:58.820801 12047 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:58.821458 12047 leader_election.cc:288] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165)
W20260809 12:03:58.823467 11904 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:03:58.823680 11903 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
I20260809 12:03:58.823787 11903 leader_election.cc:302] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e38ce37027547efa06785b9247f59bc; no voters: 061d8c3603f14343920d858e640b9dfd, abee08c3147547cc8f3379b5fc437835
I20260809 12:03:58.824051 12047 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260809 12:03:59.868662 12074 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:03:59.868875 12074 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:03:59.869582 12074 leader_election.cc:288] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165)
W20260809 12:03:59.871621 11903 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165): Network error: Client connection negotiation failed: client connection to 127.8.15.125:37165: connect: Connection refused (error 111)
W20260809 12:03:59.871816 11904 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:03:59.871948 11904 leader_election.cc:302] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e38ce37027547efa06785b9247f59bc; no voters: 061d8c3603f14343920d858e640b9dfd, abee08c3147547cc8f3379b5fc437835
I20260809 12:03:59.872159 12074 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260809 12:04:00.261475 8253 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
/tmp/dist-test-taskUkmmvv/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.15.125:37165
--webserver_interface=127.8.15.125
--webserver_port=41665
--builtin_ntp_servers=127.8.15.84:46271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--hive_metastore_uris=thrift://127.0.0.1:44923
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260809 12:04:00.604938 12084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 12:04:00.605224 12084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 12:04:00.605345 12084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 12:04:00.612696 12084 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 12:04:00.612797 12084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 12:04:00.612850 12084 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 12:04:00.612926 12084 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 12:04:00.622305 12084 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.15.84:46271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:44923
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.15.125:37165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.15.125
--webserver_port=41665
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 11:06:41 UTC on ccycloud.quasar-bwoogy.root.comops.site
build id 4575991
ASAN enabled
I20260809 12:04:00.623842 12084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 12:04:00.625818 12084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 12:04:00.638036 12101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:04:00.638267 12102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 12:04:00.638060 12106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 12:04:00.639364 12084 server_base.cc:1034] running on GCE node
I20260809 12:04:00.640336 12084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 12:04:00.641907 12084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 12:04:00.643136 12084 hybrid_clock.cc:648] HybridClock initialized: now 1786277040643061 us; error 43 us; skew 500 ppm
I20260809 12:04:00.643563 12084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 12:04:00.646440 12084 webserver.cc:460] Webserver started at http://127.8.15.125:41665/ using document root <none> and password file <none>
I20260809 12:04:00.647185 12084 fs_manager.cc:359] Metadata directory not provided
I20260809 12:04:00.647336 12084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 12:04:00.652769 12084 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 12:04:00.655802 12114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 12:04:00.657137 12084 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 12:04:00.657307 12084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data,/tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/wal
uuid: "061d8c3603f14343920d858e640b9dfd"
format_stamp: "Formatted at 2026-08-09 12:03:26 on dist-test-slave-21b9"
I20260809 12:04:00.658270 12084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 12:04:00.686848 12084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 12:04:00.687898 12084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 12:04:00.688181 12084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 12:04:00.705760 12084 rpc_server.cc:307] RPC server started. Bound to: 127.8.15.125:37165
I20260809 12:04:00.705781 12198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.8.15.125:37165 every 8 connection(s)
I20260809 12:04:00.707477 12084 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskUkmmvv/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786276989650274-8253-0/minicluster-data/master-1/data/info.pb
I20260809 12:04:00.712488 8253 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskUkmmvv/build/asan/bin/kudu as pid 12084
I20260809 12:04:00.714778 12199 sys_catalog.cc:263] Verifying existing consensus state
I20260809 12:04:00.718575 12199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: Bootstrap starting.
I20260809 12:04:00.731734 12199 log.cc:824] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: Log is configured to *not* fsync() on all Append() calls
W20260809 12:04:00.758530 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 16: this message will repeat every 5th retry.
I20260809 12:04:00.766377 9766 heartbeater.cc:347] Connected to a master server at 127.8.15.125:37165
I20260809 12:04:00.766605 9766 heartbeater.cc:503] Master 127.8.15.125:37165 was elected leader, sending a full tablet report...
I20260809 12:04:00.776214 12199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: Bootstrap replayed 1/1 log segments. Stats: ops{read=55 overwritten=0 applied=53 ignored=0} inserts{seen=38 ignored=0} mutations{seen=44 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260809 12:04:00.776847 12199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: Bootstrap complete.
I20260809 12:04:00.784440 12199 raft_consensus.cc:348] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 7 FOLLOWER]: Replica starting. Triggering 2 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:04:00.787766 12199 raft_consensus.cc:729] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 7 FOLLOWER]: Becoming Follower/Learner. State: Replica: 061d8c3603f14343920d858e640b9dfd, State: Initialized, Role: FOLLOWER
I20260809 12:04:00.788460 12199 consensus_queue.cc:260] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 53, Last appended: 7.55, Last appended by leader: 55, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:04:00.789273 12206 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:04:00.789642 12206 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:04:00.790287 12199 sys_catalog.cc:564] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 12:04:00.801697 12227 catalog_manager.cc:1259] Loaded cluster ID: a0f048c3ad03482e99d22bfc404ede58
I20260809 12:04:00.801890 12227 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: loading cluster ID for follower catalog manager: success
I20260809 12:04:00.806346 12227 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: acquiring CA information for follower catalog manager: success
I20260809 12:04:00.809952 12227 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 12:04:00.811302 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:04:00.822265 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:04:00.833739 9530 heartbeater.cc:347] Connected to a master server at 127.8.15.125:37165
I20260809 12:04:00.833958 9530 heartbeater.cc:503] Master 127.8.15.125:37165 was elected leader, sending a full tablet report...
I20260809 12:04:00.837301 12142 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" instance_seqno: 1786277009716171) as {username='slave'} at 127.8.15.66:53831; Asking this server to re-register.
I20260809 12:04:00.838344 9530 heartbeater.cc:464] Registering TS with master...
I20260809 12:04:00.840153 12142 ts_manager.cc:194] Registered new tserver with Master: cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479)
I20260809 12:04:00.855365 9308 heartbeater.cc:347] Connected to a master server at 127.8.15.125:37165
I20260809 12:04:00.855625 9308 heartbeater.cc:503] Master 127.8.15.125:37165 was elected leader, sending a full tablet report...
I20260809 12:04:00.857213 12142 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" instance_seqno: 1786277008701240) as {username='slave'} at 127.8.15.65:40307; Asking this server to re-register.
I20260809 12:04:00.857772 9308 heartbeater.cc:464] Registering TS with master...
I20260809 12:04:00.859016 12142 ts_manager.cc:194] Registered new tserver with Master: f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
I20260809 12:04:00.990906 12236 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 12:04:00.991122 12236 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:04:00.991962 12236 leader_election.cc:288] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165)
W20260809 12:04:00.995208 11904 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:04:01.000407 12169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e38ce37027547efa06785b9247f59bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 56 } } ignore_live_leader: false dest_uuid: "061d8c3603f14343920d858e640b9dfd" is_pre_election: true
I20260809 12:04:01.001005 12169 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e38ce37027547efa06785b9247f59bc in term 7.
I20260809 12:04:01.001688 11903 leader_election.cc:302] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd, 1e38ce37027547efa06785b9247f59bc; no voters: abee08c3147547cc8f3379b5fc437835
I20260809 12:04:01.001986 12236 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260809 12:04:01.002125 12236 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 12:04:01.002229 12236 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 8 FOLLOWER]: Advancing to term 9
I20260809 12:04:01.006218 12236 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:04:01.006798 12236 leader_election.cc:288] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 election: Requested vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 061d8c3603f14343920d858e640b9dfd (127.8.15.125:37165)
I20260809 12:04:01.007436 12169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e38ce37027547efa06785b9247f59bc" candidate_term: 9 candidate_status { last_received { term: 8 index: 56 } } ignore_live_leader: false dest_uuid: "061d8c3603f14343920d858e640b9dfd"
I20260809 12:04:01.007666 12169 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 7 FOLLOWER]: Advancing to term 9
W20260809 12:04:01.008385 11904 leader_election.cc:334] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:04:01.013168 12169 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e38ce37027547efa06785b9247f59bc in term 9.
I20260809 12:04:01.013656 11903 leader_election.cc:302] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd, 1e38ce37027547efa06785b9247f59bc; no voters: abee08c3147547cc8f3379b5fc437835
I20260809 12:04:01.013957 12236 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 9 FOLLOWER]: Leader election won for term 9
I20260809 12:04:01.014516 12236 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [term 9 LEADER]: Becoming Leader. State: Replica: 1e38ce37027547efa06785b9247f59bc, State: Running, Role: LEADER
I20260809 12:04:01.015089 12236 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 56, Committed index: 56, Last appended: 8.56, Last appended by leader: 56, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:04:01.018234 12247 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e38ce37027547efa06785b9247f59bc. Latest consensus state: current_term: 9 leader_uuid: "1e38ce37027547efa06785b9247f59bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:04:01.018642 12247 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: This master's current role is: LEADER
I20260809 12:04:01.019366 12252 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 12:04:01.022042 12252 catalog_manager.cc:669] Loaded metadata for table default.table_da029d70439d48cc842a66906f93d903 [id=085a7a8b72ea4da2817e62d516fbcc38]
I20260809 12:04:01.022517 12252 catalog_manager.cc:669] Loaded metadata for table default.table_8ccd04aad0ba4f5480308b917eb8a12e [id=325c41115c9d4a16820f3f3e2c53ab6b]
I20260809 12:04:01.022825 12252 catalog_manager.cc:669] Loaded metadata for table default.table_e97f6ba8b3354e24926902268c43a5e3 [id=5239b7194cf944d881c8c4b6113b0dfa]
I20260809 12:04:01.023142 12252 catalog_manager.cc:669] Loaded metadata for table default.table_1692567d64f8469c8550ff24a79d3e57 [id=560f9d6ae1904b3ba73a0b3ed65fddbe]
I20260809 12:04:01.023464 12252 catalog_manager.cc:669] Loaded metadata for table default.table_22580336a00e422aab032707ca16836e [id=6999f70d421f4417b855c361afdebc21]
I20260809 12:04:01.023774 12252 catalog_manager.cc:669] Loaded metadata for table default.table_520e75ee39c74e6985dbd81c6f2e32f8 [id=78883a236d6b4026a725d3a3cc60dec1]
I20260809 12:04:01.024062 12252 catalog_manager.cc:669] Loaded metadata for table default.table_939805886d394093ad5a402efa777cb4 [id=87a2e7cf29fa4fdc8d5ea2173cdc1c2d]
I20260809 12:04:01.024349 12252 catalog_manager.cc:669] Loaded metadata for table default.table_22e16baa34234ab0a0b7841c1041884c [id=a090addd1b9f4126b16d72d49ac02669]
I20260809 12:04:01.024629 12252 catalog_manager.cc:669] Loaded metadata for table default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf]
I20260809 12:04:01.026921 12252 tablet_loader.cc:96] loaded metadata for tablet 1c975cc8e50c41eaa6e0512666fa3892 (table default.table_22580336a00e422aab032707ca16836e [id=6999f70d421f4417b855c361afdebc21])
I20260809 12:04:01.027382 12252 tablet_loader.cc:96] loaded metadata for tablet 2e2f427c244f4438bcbf26ef6f5bb0e6 (table default.table_939805886d394093ad5a402efa777cb4 [id=87a2e7cf29fa4fdc8d5ea2173cdc1c2d])
I20260809 12:04:01.028158 12252 tablet_loader.cc:96] loaded metadata for tablet 6186291190194276958873fba5011624 (table default.table_8ccd04aad0ba4f5480308b917eb8a12e [id=325c41115c9d4a16820f3f3e2c53ab6b])
I20260809 12:04:01.028532 12252 tablet_loader.cc:96] loaded metadata for tablet 6e51d6c18fd34cf29dd0ac00e81a4a8c (table default.table_5e7b5144853246789d8fc5da01626dc7 [id=cdf9b699ee5c4b34ae416c1bc8922daf])
I20260809 12:04:01.028918 12252 tablet_loader.cc:96] loaded metadata for tablet 76a803b3bb8844068c58fd4fc8f57e37 (table default.table_e97f6ba8b3354e24926902268c43a5e3 [id=5239b7194cf944d881c8c4b6113b0dfa])
I20260809 12:04:01.029198 12252 tablet_loader.cc:96] loaded metadata for tablet 776e37328c3c4c5f8a3477300ef747fa (table default.table_22e16baa34234ab0a0b7841c1041884c [id=a090addd1b9f4126b16d72d49ac02669])
I20260809 12:04:01.030072 12252 tablet_loader.cc:96] loaded metadata for tablet d5f97f6d773e4d0a9485ecb0404d4ff7 (table default.table_520e75ee39c74e6985dbd81c6f2e32f8 [id=78883a236d6b4026a725d3a3cc60dec1])
I20260809 12:04:01.030440 12252 tablet_loader.cc:96] loaded metadata for tablet e35641497b3849a0b712234a243699da (table default.table_1692567d64f8469c8550ff24a79d3e57 [id=560f9d6ae1904b3ba73a0b3ed65fddbe])
I20260809 12:04:01.030715 12252 tablet_loader.cc:96] loaded metadata for tablet eb1084478c8043ce860c786130f25350 (table default.table_da029d70439d48cc842a66906f93d903 [id=085a7a8b72ea4da2817e62d516fbcc38])
I20260809 12:04:01.031203 12252 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 12:04:01.032292 12252 catalog_manager.cc:1259] Loaded cluster ID: a0f048c3ad03482e99d22bfc404ede58
I20260809 12:04:01.032377 12252 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 12:04:01.033926 12252 catalog_manager.cc:1504] Loading token signing keys...
I20260809 12:04:01.034925 12252 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc: Loaded TSK: 0
I20260809 12:04:01.035878 12252 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 12:04:01.036875 12252 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260809 12:04:01.037797 12252 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: -1
I20260809 12:04:01.270197 9766 heartbeater.cc:503] Master 127.8.15.125:37165 was elected leader, sending a full tablet report...
I20260809 12:04:01.272205 12142 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" instance_seqno: 1786277010606266) as {username='slave'} at 127.8.15.67:42171; Asking this server to re-register.
I20260809 12:04:01.272923 9766 heartbeater.cc:464] Registering TS with master...
I20260809 12:04:01.274386 12142 ts_manager.cc:194] Registered new tserver with Master: e0b5e4c0505c4122ae1349ee4beb5bd1 (127.8.15.67:34793)
I20260809 12:04:01.449744 12169 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Refusing update from remote peer 1e38ce37027547efa06785b9247f59bc: Log matching property violated. Preceding OpId in replica: term: 7 index: 55. Preceding OpId from leader: term: 9 index: 57. (index mismatch)
I20260809 12:04:01.450912 12247 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 57, Last known committed idx: 53, Time since last communication: 0.000s
I20260809 12:04:01.458627 12260 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 9 leader_uuid: "1e38ce37027547efa06785b9247f59bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:04:01.458971 12260 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:04:01.459800 12258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 9 leader_uuid: "1e38ce37027547efa06785b9247f59bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:04:01.460530 12258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:04:01.460402 12255 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e38ce37027547efa06785b9247f59bc. Latest consensus state: current_term: 9 leader_uuid: "1e38ce37027547efa06785b9247f59bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:04:01.461028 12255 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:04:01.461222 12258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 9 leader_uuid: "1e38ce37027547efa06785b9247f59bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:04:01.461552 12258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [sys.catalog]: This master's current role is: FOLLOWER
I20260809 12:04:01.463127 12236 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 9 leader_uuid: "1e38ce37027547efa06785b9247f59bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } } }
I20260809 12:04:01.463467 12236 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc [sys.catalog]: This master's current role is: LEADER
W20260809 12:04:01.464006 11904 consensus_peers.cc:487] T 00000000000000000000000000000000 P 1e38ce37027547efa06785b9247f59bc -> Peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Couldn't send request to peer abee08c3147547cc8f3379b5fc437835. Status: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
F20260809 12:04:01.530820 12017 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 1): 1 CREATE_TABLE default.table_badbfc92917e45a5aa60e47244ae5ff5
*** Check failure stack trace: ***
@ 0x7f96288de9ad google::LogMessage::Fail() at ??:0
@ 0x7f96288e188a google::LogMessage::SendToLog() at ??:0
@ 0x7f96288de4de google::LogMessage::Flush() at ??:0
@ 0x7f96288de6d1 google::LogMessage::~LogMessage() at ??:0
@ 0x7f963e47cba8 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f963e47b901 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7f963e48266c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260809 12:04:01.556293 9765 heartbeater.cc:503] Master 127.8.15.124:33307 was elected leader, sending a full tablet report...
@ 0x7f963e4824e9 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f962b508eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f962e7e26db start_thread at ??:0
@ 0x7f962777861f clone at ??:0
W20260809 12:04:01.806246 9575 connection.cc:535] client connection to 127.8.15.124:33307 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:04:01.806334 9782 connection.cc:535] client connection to 127.8.15.124:33307 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 12:04:01.807240 12282 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 12:04:01.563550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54852 (local address 127.8.15.67:34793)
0809 12:04:01.569156 (+ 5606us) server_negotiation.cc:206] Beginning negotiation
0809 12:04:01.569165 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 12:04:01.569190 (+ 25us) server_negotiation.cc:407] Connection header received
0809 12:04:01.569275 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 12:04:01.569282 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 12:04:01.569367 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 12:04:01.570063 (+ 696us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 12:04:01.570302 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 12:04:01.571571 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 12:04:01.806941 (+235370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54852: BlockingRecv error: recv got EOF from 127.0.0.1:54852 (error 108)
Metrics: {"server-negotiator.queue_time_us":5409,"thread_start_us":5178,"threads_started":1}
I20260809 12:04:01.936796 9300 heartbeater.cc:503] Master 127.8.15.124:33307 was elected leader, sending a full tablet report...
I20260809 12:04:01.936877 9529 heartbeater.cc:503] Master 127.8.15.124:33307 was elected leader, sending a full tablet report...
I20260809 12:04:01.961220 12258 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:04:01.961508 12258 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:04:01.963387 12258 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:04:01.964452 12120 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
W20260809 12:04:01.965664 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:04:01.965886 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:04:01.966099 12120 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:04:01.966432 12258 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260809 12:04:02.498543 12311 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:04:02.498749 12311 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:04:02.499477 12311 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:04:02.501188 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:04:02.501371 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:04:02.501510 12120 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:04:02.501772 12311 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260809 12:04:02.914549 8253 master-stress-test.cc:578] Killing test thread 1/25
W20260809 12:04:03.165815 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 16: this message will repeat every 5th retry.
I20260809 12:04:03.597541 12328 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:04:03.597734 12328 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:04:03.598357 12328 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:04:03.600284 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:04:03.600442 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:04:03.600594 12120 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:04:03.600805 12328 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260809 12:04:04.682379 12346 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:04:04.682657 12346 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:04:04.683509 12346 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:04:04.685555 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:04:04.685735 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:04:04.685853 12120 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:04:04.686093 12346 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260809 12:04:05.823706 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:04:05.823894 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:04:06.340876 12376 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:04:06.341092 12376 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:04:06.341801 12376 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:04:06.345050 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:04:06.345227 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:04:06.345350 12120 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:04:06.345600 12376 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260809 12:04:09.685227 12408 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:04:09.685457 12408 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:04:09.686270 12408 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:04:09.687357 12117 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20260809 12:04:09.688681 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
W20260809 12:04:09.688879 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:04:09.689002 12117 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:04:09.689276 12408 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260809 12:04:10.825621 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:04:10.825814 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:04:10.996500 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 21: this message will repeat every 5th retry.
I20260809 12:04:13.274178 12445 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:04:13.274417 12445 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:04:13.275238 12445 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:04:13.276207 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:04:13.276372 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:04:13.276511 9571 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:04:13.276799 12445 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260809 12:04:13.668560 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 21: this message will repeat every 5th retry.
I20260809 12:04:13.716955 12456 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:04:13.717136 12456 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:04:13.717768 12456 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:04:13.719987 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:04:13.720175 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:04:13.720309 12120 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:04:13.720558 12456 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260809 12:04:15.828382 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:04:15.828620 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:04:17.858078 12513 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:04:17.858306 12513 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:04:17.859150 12513 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:04:17.860219 12117 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260809 12:04:17.861407 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
W20260809 12:04:17.861579 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:04:17.861697 12117 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:04:17.861981 12513 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260809 12:04:20.445278 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 26: this message will repeat every 5th retry.
I20260809 12:04:20.830312 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:04:20.830531 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:04:22.245755 12569 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:04:22.245998 12569 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:04:22.246635 12569 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:04:22.249076 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
W20260809 12:04:22.249262 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:04:22.249397 12117 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:04:22.249645 12569 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260809 12:04:22.410182 12573 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:04:22.410434 12573 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:04:22.411164 12573 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:04:22.412086 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:04:22.412274 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:04:22.412376 9571 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:04:22.412603 12573 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260809 12:04:23.631227 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 26: this message will repeat every 5th retry.
I20260809 12:04:25.163863 12613 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:04:25.164072 12613 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:04:25.164799 12613 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:04:25.165939 12117 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260809 12:04:25.167315 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:04:25.167531 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:04:25.167646 12120 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:04:25.167908 12613 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260809 12:04:25.832237 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:04:25.832430 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:04:29.775688 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 31: this message will repeat every 5th retry.
I20260809 12:04:30.362092 12681 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:04:30.362353 12681 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:04:30.363365 12681 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:04:30.364406 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:04:30.364599 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:04:30.364705 9573 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:04:30.364926 12681 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 12:04:30.834017 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:04:30.834199 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:04:31.010294 9300 heartbeater.cc:644] Failed to heartbeat to 127.8.15.124:33307 (58 consecutive failures): Network error: Failed to ping master at 127.8.15.124:33307: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
W20260809 12:04:31.010352 9529 heartbeater.cc:644] Failed to heartbeat to 127.8.15.124:33307 (58 consecutive failures): Network error: Failed to ping master at 127.8.15.124:33307: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:04:31.042208 12692 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:04:31.042446 12692 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:04:31.043170 12692 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:04:31.043826 12120 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260809 12:04:31.045329 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
W20260809 12:04:31.045531 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:04:31.045656 12117 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:04:31.045897 12692 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260809 12:04:31.197016 9763 heartbeater.cc:644] Failed to heartbeat to 127.8.15.126:45327 (121 consecutive failures): Network error: Failed to ping master at 127.8.15.126:45327: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:04:33.248629 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 31: this message will repeat every 5th retry.
I20260809 12:04:35.835804 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:04:35.836016 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:04:39.012970 12788 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:04:39.013171 12788 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:04:39.013914 12788 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:04:39.014967 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:04:39.015188 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:04:39.015358 9573 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:04:39.015636 12788 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260809 12:04:40.026866 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 36: this message will repeat every 5th retry.
I20260809 12:04:40.837683 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:04:40.837877 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:04:42.513159 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 36: this message will repeat every 5th retry.
I20260809 12:04:45.839587 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:04:45.839905 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:04:47.227878 12878 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:04:47.228216 12878 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:04:47.229660 12878 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:04:47.231666 12120 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260809 12:04:47.233595 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
W20260809 12:04:47.233922 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:04:47.234089 12117 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:04:47.234391 12878 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260809 12:04:50.051622 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 41: this message will repeat every 5th retry.
I20260809 12:04:50.841699 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:04:50.841898 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:04:53.069275 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 41: this message will repeat every 5th retry.
I20260809 12:04:54.904551 12971 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:04:54.904821 12971 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:04:54.905656 12971 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:04:54.906980 12120 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260809 12:04:54.908514 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
W20260809 12:04:54.908766 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:04:54.908910 12117 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:04:54.909253 12971 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260809 12:04:55.491797 12969 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:04:55.492244 12969 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:04:55.494240 12969 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:04:55.495906 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:04:55.496316 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:04:55.496569 9571 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:04:55.497020 12969 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 12:04:55.845242 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:04:55.845713 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:04:56.724915 12996 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:04:56.725282 12996 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:04:56.726648 12996 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:04:56.730378 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:04:56.730924 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:04:56.731118 12120 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:04:56.731647 12996 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260809 12:05:00.100843 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 46: this message will repeat every 5th retry.
I20260809 12:05:00.847924 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:05:00.848204 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:05:03.727684 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 46: this message will repeat every 5th retry.
I20260809 12:05:05.077685 13089 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:05:05.078086 13089 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:05:05.079233 13089 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:05:05.080384 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:05:05.080572 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:05:05.080700 9571 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:05:05.081060 13089 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 12:05:05.849448 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:05:05.849612 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:05:10.782279 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 51: this message will repeat every 5th retry.
I20260809 12:05:10.851581 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:05:10.851780 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:05:14.445170 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 51: this message will repeat every 5th retry.
I20260809 12:05:15.853614 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:05:15.853807 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:05:16.243763 13236 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:05:16.244033 13236 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:05:16.245409 13236 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:05:16.245950 12117 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260809 12:05:16.248656 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
W20260809 12:05:16.248974 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:05:16.249179 12117 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:05:16.249491 13236 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260809 12:05:16.483346 13230 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:05:16.483873 13230 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:05:16.485376 13230 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:05:16.486338 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:05:16.486526 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:05:16.486629 9573 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:05:16.486945 13230 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 12:05:17.074153 13244 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:05:17.074388 13244 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:05:17.075151 13244 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:05:17.078454 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
W20260809 12:05:17.078982 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:05:17.079173 12117 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:05:17.079598 13244 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260809 12:05:19.939122 13273 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:05:19.939369 13273 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:05:19.940040 13273 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:05:19.943953 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:05:19.944142 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:05:19.944268 12120 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:05:19.944643 13273 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260809 12:05:20.758759 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 56: this message will repeat every 5th retry.
I20260809 12:05:20.855377 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:05:20.855643 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:05:24.765661 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 56: this message will repeat every 5th retry.
I20260809 12:05:25.857197 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:05:25.857424 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:05:26.025516 13349 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:05:26.025830 13349 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:05:26.027101 13349 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:05:26.028213 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:05:26.028447 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:05:26.028671 9573 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:05:26.028995 13349 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 12:05:30.074913 13397 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:05:30.075208 13397 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:05:30.075930 13397 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:05:30.077191 12117 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260809 12:05:30.078363 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
W20260809 12:05:30.078670 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:05:30.078864 12117 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:05:30.079105 13397 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260809 12:05:30.859052 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:05:30.859400 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:05:31.066040 9298 heartbeater.cc:644] Failed to heartbeat to 127.8.15.126:45327 (197 consecutive failures): Network error: Failed to ping master at 127.8.15.126:45327: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:05:31.066061 9527 heartbeater.cc:644] Failed to heartbeat to 127.8.15.126:45327 (197 consecutive failures): Network error: Failed to ping master at 127.8.15.126:45327: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:05:31.362254 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 61: this message will repeat every 5th retry.
W20260809 12:05:31.362382 9763 heartbeater.cc:644] Failed to heartbeat to 127.8.15.126:45327 (308 consecutive failures): Network error: Failed to ping master at 127.8.15.126:45327: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:05:31.931456 13423 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:05:31.931882 13423 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:05:31.933653 13423 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:05:31.934707 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:05:31.934890 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:05:31.934996 9573 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:05:31.935351 13423 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260809 12:05:34.761174 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 61: this message will repeat every 5th retry.
I20260809 12:05:35.861279 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:05:35.861492 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:05:38.216427 13500 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:05:38.216683 13500 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:05:38.217417 13500 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:05:38.218469 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:05:38.218747 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:05:38.218892 9573 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:05:38.219301 13500 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260809 12:05:40.433007 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 66: this message will repeat every 5th retry.
I20260809 12:05:40.863516 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:05:40.863786 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:05:44.677594 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 66: this message will repeat every 5th retry.
I20260809 12:05:45.865270 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:05:45.865473 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:05:48.789696 13618 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:05:48.790027 13618 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:05:48.791038 13618 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:05:48.793478 12120 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260809 12:05:48.795360 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:05:48.795674 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:05:48.795884 12120 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:05:48.796159 13618 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260809 12:05:50.795094 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 71: this message will repeat every 5th retry.
I20260809 12:05:50.867172 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:05:50.867424 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:05:51.927562 13653 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:05:51.927839 13653 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:05:51.928933 13653 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:05:51.930159 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:05:51.930428 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:05:51.930677 9571 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:05:51.931066 13653 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260809 12:05:54.864414 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 71: this message will repeat every 5th retry.
I20260809 12:05:55.869417 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:05:55.869730 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:06:00.307108 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 76: this message will repeat every 5th retry.
I20260809 12:06:00.871448 12124 maintenance_manager.cc:419] P 061d8c3603f14343920d858e640b9dfd: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033356
I20260809 12:06:00.871577 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:06:00.872061 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:06:00.941807 12122 maintenance_manager.cc:643] P 061d8c3603f14343920d858e640b9dfd: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.069s user 0.040s sys 0.008s Metrics: {"bytes_written":17218,"cfile_init":1,"dirs.queue_time_us":634,"dirs.run_cpu_time_us":222,"dirs.run_wall_time_us":893,"drs_written":1,"lbm_read_time_us":105,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1191,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":38,"thread_start_us":896,"threads_started":2,"wal-append.queue_time_us":772}
I20260809 12:06:00.943758 12124 maintenance_manager.cc:419] P 061d8c3603f14343920d858e640b9dfd: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 2071 bytes on disk
I20260809 12:06:00.944707 12122 maintenance_manager.cc:643] P 061d8c3603f14343920d858e640b9dfd: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":79,"lbm_reads_lt_1ms":4}
I20260809 12:06:02.282660 13801 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:06:02.282960 13801 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:06:02.284188 13801 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:06:02.286163 12120 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260809 12:06:02.288197 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
W20260809 12:06:02.288455 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:06:02.288656 12117 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:06:02.288971 13801 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260809 12:06:04.685662 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 76: this message will repeat every 5th retry.
I20260809 12:06:05.873728 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:06:05.873935 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:06:07.552548 13896 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:06:07.552750 13896 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:06:07.553583 13896 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:06:07.554682 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:06:07.554883 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:06:07.554986 9573 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:06:07.555222 13896 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260809 12:06:10.837136 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 81: this message will repeat every 5th retry.
I20260809 12:06:10.876004 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:06:10.876204 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:06:14.786417 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 81: this message will repeat every 5th retry.
I20260809 12:06:15.852859 14038 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:06:15.853135 14038 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:06:15.854125 14038 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:06:15.855099 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:06:15.855371 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:06:15.855571 9571 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:06:15.855823 14038 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 12:06:15.877753 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:06:15.877914 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:06:18.701650 14095 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:06:18.701936 14095 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:06:18.702977 14095 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:06:18.704442 12120 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260809 12:06:18.705920 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:06:18.706286 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:06:18.706504 12120 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:06:18.706822 14095 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260809 12:06:20.840884 14135 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:06:20.841130 14135 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:06:20.841871 14135 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:06:20.842937 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:06:20.843132 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:06:20.843305 9571 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:06:20.843650 14135 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 12:06:20.879876 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:06:20.880160 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:06:20.945948 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 86: this message will repeat every 5th retry.
W20260809 12:06:24.941032 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 86: this message will repeat every 5th retry.
I20260809 12:06:25.881860 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:06:25.882062 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:06:30.822299 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 91: this message will repeat every 5th retry.
I20260809 12:06:30.883945 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:06:30.884142 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:06:31.222741 9298 heartbeater.cc:644] Failed to heartbeat to 127.8.15.126:45327 (317 consecutive failures): Network error: Failed to ping master at 127.8.15.126:45327: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:06:31.222831 9527 heartbeater.cc:644] Failed to heartbeat to 127.8.15.126:45327 (317 consecutive failures): Network error: Failed to ping master at 127.8.15.126:45327: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:06:31.834841 9765 heartbeater.cc:644] Failed to heartbeat to 127.8.15.124:33307 (465 consecutive failures): Network error: Failed to ping master at 127.8.15.124:33307: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:06:32.518009 14329 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:06:32.518299 14329 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:06:32.519156 14329 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:06:32.520409 12120 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260809 12:06:32.521994 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
W20260809 12:06:32.522230 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:06:32.522428 12117 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:06:32.522712 14329 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260809 12:06:34.468538 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 91: this message will repeat every 5th retry.
I20260809 12:06:35.885790 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:06:35.886009 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:06:38.261904 14428 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:06:38.262143 14428 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:06:38.263402 14428 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:06:38.264298 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:06:38.264482 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:06:38.264642 9571 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:06:38.265021 14428 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260809 12:06:40.369753 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 96: this message will repeat every 5th retry.
I20260809 12:06:40.887936 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:06:40.888216 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:06:44.691824 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 96: this message will repeat every 5th retry.
I20260809 12:06:45.890378 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:06:45.890602 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:06:48.162971 14594 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:06:48.163336 14594 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:06:48.164369 14594 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:06:48.165784 12120 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260809 12:06:48.167802 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
W20260809 12:06:48.168061 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:06:48.168200 12117 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:06:48.168582 14594 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260809 12:06:50.572767 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 101: this message will repeat every 5th retry.
I20260809 12:06:50.892297 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:06:50.892513 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:06:54.607133 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 101: this message will repeat every 5th retry.
I20260809 12:06:55.894280 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:06:55.894516 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:06:57.773277 14762 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:06:57.773530 14762 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:06:57.774893 14762 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:06:57.775909 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:06:57.776156 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:06:57.776413 9571 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:06:57.776775 14762 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 12:07:00.240221 14798 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:07:00.240480 14798 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:07:00.241391 14798 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:07:00.242601 12117 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260809 12:07:00.244046 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:07:00.244256 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:07:00.244433 12120 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:07:00.244709 14798 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260809 12:07:00.896292 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:07:00.896649 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:07:00.960590 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 106: this message will repeat every 5th retry.
I20260809 12:07:02.270177 14839 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:07:02.270488 14839 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:07:02.271714 14839 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:07:02.275295 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:07:02.275602 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:07:02.275867 12120 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:07:02.276261 14839 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260809 12:07:05.219559 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 106: this message will repeat every 5th retry.
I20260809 12:07:05.668094 14890 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:07:05.668313 14890 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:07:05.669251 14890 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:07:05.670157 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:07:05.670476 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:07:05.670676 9573 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:07:05.671025 14890 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 12:07:05.825186 14902 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:07:05.825399 14902 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:07:05.826169 14902 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:07:05.827176 12117 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260809 12:07:05.828665 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:07:05.828900 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:07:05.829159 12120 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:07:05.829424 14902 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260809 12:07:05.897993 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:07:05.898195 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:07:10.899930 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:07:10.900142 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:07:11.447434 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 111: this message will repeat every 5th retry.
I20260809 12:07:12.869189 15025 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:07:12.869567 15025 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:07:12.870421 15025 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:07:12.872150 12117 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260809 12:07:12.873772 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
W20260809 12:07:12.873996 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:07:12.874215 12117 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:07:12.874475 15025 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260809 12:07:15.901878 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:07:15.902109 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:07:15.958945 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 111: this message will repeat every 5th retry.
I20260809 12:07:17.091049 15091 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:07:17.091428 15091 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:07:17.092442 15091 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:07:17.095479 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:07:17.095782 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:07:17.095997 12120 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:07:17.096333 15091 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260809 12:07:20.903997 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:07:20.904295 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:07:21.447440 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 116: this message will repeat every 5th retry.
I20260809 12:07:22.166800 15168 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:07:22.167028 15168 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:07:22.168207 15168 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:07:22.169464 12117 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260809 12:07:22.172029 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:07:22.172245 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:07:22.172408 12120 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:07:22.172763 15168 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260809 12:07:22.656273 15181 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:07:22.656702 15181 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:07:22.658227 15181 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:07:22.659314 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:07:22.659587 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:07:22.659781 9573 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:07:22.660128 15181 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 12:07:25.906353 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:07:25.906571 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:07:26.347302 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 116: this message will repeat every 5th retry.
I20260809 12:07:28.562299 15256 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:07:28.562574 15256 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:07:28.563390 15256 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:07:28.564245 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:07:28.564447 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:07:28.564559 9573 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:07:28.564911 15256 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 12:07:30.909020 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:07:30.909334 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:07:30.955044 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 121: this message will repeat every 5th retry.
W20260809 12:07:31.380721 9527 heartbeater.cc:644] Failed to heartbeat to 127.8.15.126:45327 (437 consecutive failures): Network error: Failed to ping master at 127.8.15.126:45327: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:07:31.381211 9298 heartbeater.cc:644] Failed to heartbeat to 127.8.15.126:45327 (437 consecutive failures): Network error: Failed to ping master at 127.8.15.126:45327: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:07:32.089022 9765 heartbeater.cc:644] Failed to heartbeat to 127.8.15.124:33307 (649 consecutive failures): Network error: Failed to ping master at 127.8.15.124:33307: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:07:33.808143 15342 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:07:33.808482 15342 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:07:33.809429 15342 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:07:33.810343 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:07:33.810576 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:07:33.810797 9571 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:07:33.811216 15342 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 12:07:35.910966 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:07:35.911154 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:07:36.644915 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 121: this message will repeat every 5th retry.
I20260809 12:07:40.913115 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:07:40.913313 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:07:41.068492 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 126: this message will repeat every 5th retry.
I20260809 12:07:41.615933 15452 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:07:41.616226 15452 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:07:41.617623 15452 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:07:41.619400 12120 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260809 12:07:41.620698 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
W20260809 12:07:41.620934 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:07:41.621217 12117 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:07:41.621631 15452 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260809 12:07:45.398077 15524 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:07:45.398280 15524 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:07:45.399091 15524 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:07:45.402736 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:07:45.403049 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:07:45.403247 12120 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:07:45.403695 15524 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260809 12:07:45.914950 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:07:45.915141 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:07:46.474550 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 126: this message will repeat every 5th retry.
I20260809 12:07:47.059145 15564 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:07:47.059587 15564 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:07:47.061041 15564 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:07:47.062018 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:07:47.062279 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:07:47.062520 9571 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:07:47.062774 15564 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 12:07:50.917199 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:07:50.917488 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:07:51.416657 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 131: this message will repeat every 5th retry.
I20260809 12:07:55.919665 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:07:55.919905 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:07:56.313079 15684 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:07:56.313303 15684 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:07:56.313968 15684 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:07:56.315058 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:07:56.315243 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:07:56.315513 9573 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:07:56.315781 15684 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260809 12:07:56.784832 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 131: this message will repeat every 5th retry.
I20260809 12:08:00.921999 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:08:00.922302 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:08:01.325698 15760 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:08:01.325919 15760 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:08:01.327152 15760 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:08:01.327724 12120 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260809 12:08:01.328869 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:08:01.329113 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:08:01.329339 12120 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:08:01.329607 15760 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260809 12:08:01.843693 15774 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:08:01.843874 15774 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:08:01.844422 15774 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:08:01.846804 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
W20260809 12:08:01.846948 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:08:01.847080 12117 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:08:01.847363 15774 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260809 12:08:01.881938 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 136: this message will repeat every 5th retry.
I20260809 12:08:05.923980 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:08:05.924214 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:08:06.187156 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 136: this message will repeat every 5th retry.
I20260809 12:08:07.818506 15855 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:08:07.818835 15855 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:08:07.825714 15855 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:08:07.832075 12120 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260809 12:08:07.833552 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:08:07.833727 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:08:07.833845 12120 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:08:07.834100 15855 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260809 12:08:10.926452 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:08:10.926710 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 12:08:11.989252 15924 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:08:11.989554 15924 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:08:11.990478 15924 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:08:11.993296 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:08:11.993537 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:08:11.993716 12120 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:08:11.994077 15924 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260809 12:08:12.952598 15940 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:08:12.952940 15940 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:08:12.953974 15940 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:08:12.954983 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:08:12.955191 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:08:12.955322 9571 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:08:12.955600 15940 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260809 12:08:12.974879 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 141: this message will repeat every 5th retry.
I20260809 12:08:15.928622 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:08:15.928840 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:08:16.011372 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 141: this message will repeat every 5th retry.
I20260809 12:08:19.773397 16023 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:08:19.773741 16023 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:08:19.774628 16023 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:08:19.775691 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:08:19.775867 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:08:19.776002 9571 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:08:19.776309 16023 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 12:08:20.931322 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:08:20.931619 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:08:22.576457 9573 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Couldn't send request to peer cde39fbb4ced4d049fef6754c3f3e796. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 146: this message will repeat every 5th retry.
I20260809 12:08:25.933310 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:08:25.933540 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:08:26.298218 9571 consensus_peers.cc:487] T 12eb84afa6ce467989205478da21f1bf P e0b5e4c0505c4122ae1349ee4beb5bd1 -> Peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Couldn't send request to peer f05528ac015e4f0cb0aa748afdc2c12e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12eb84afa6ce467989205478da21f1bf. This is attempt 146: this message will repeat every 5th retry.
I20260809 12:08:26.553781 16125 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:08:26.554044 16125 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:08:26.554733 16125 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:08:26.555740 12120 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260809 12:08:26.557327 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
W20260809 12:08:26.557525 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
I20260809 12:08:26.557670 12117 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:08:26.557930 16125 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260809 12:08:27.717700 16139 raft_consensus.cc:482] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cde39fbb4ced4d049fef6754c3f3e796)
I20260809 12:08:27.718060 16139 raft_consensus.cc:504] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cde39fbb4ced4d049fef6754c3f3e796" member_type: VOTER last_known_addr { host: "127.8.15.66" port: 41479 } } peers { permanent_uuid: "f05528ac015e4f0cb0aa748afdc2c12e" member_type: VOTER last_known_addr { host: "127.8.15.65" port: 38723 } } peers { permanent_uuid: "e0b5e4c0505c4122ae1349ee4beb5bd1" member_type: VOTER last_known_addr { host: "127.8.15.67" port: 34793 } }
I20260809 12:08:27.718854 16139 leader_election.cc:288] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479), f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723)
W20260809 12:08:27.720018 9573 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cde39fbb4ced4d049fef6754c3f3e796 (127.8.15.66:41479): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
W20260809 12:08:27.720290 9571 leader_election.cc:341] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f05528ac015e4f0cb0aa748afdc2c12e (127.8.15.65:38723): Not found: Tablet not found: 37059914646d4ae09e036e9ceaad2b11
I20260809 12:08:27.720448 9571 leader_election.cc:302] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0b5e4c0505c4122ae1349ee4beb5bd1; no voters: cde39fbb4ced4d049fef6754c3f3e796, f05528ac015e4f0cb0aa748afdc2c12e
I20260809 12:08:27.720723 16139 raft_consensus.cc:2726] T 37059914646d4ae09e036e9ceaad2b11 P e0b5e4c0505c4122ae1349ee4beb5bd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 12:08:30.001721 16182 raft_consensus.cc:482] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e38ce37027547efa06785b9247f59bc)
I20260809 12:08:30.001958 16182 raft_consensus.cc:504] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abee08c3147547cc8f3379b5fc437835" member_type: VOTER last_known_addr { host: "127.8.15.126" port: 45327 } } peers { permanent_uuid: "061d8c3603f14343920d858e640b9dfd" member_type: VOTER last_known_addr { host: "127.8.15.125" port: 37165 } } peers { permanent_uuid: "1e38ce37027547efa06785b9247f59bc" member_type: VOTER last_known_addr { host: "127.8.15.124" port: 33307 } }
I20260809 12:08:30.002750 16182 leader_election.cc:288] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327), 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307)
W20260809 12:08:30.005280 12117 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer abee08c3147547cc8f3379b5fc437835 (127.8.15.126:45327): Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:08:30.005652 12120 leader_election.cc:334] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1e38ce37027547efa06785b9247f59bc (127.8.15.124:33307): Network error: Client connection negotiation failed: client connection to 127.8.15.124:33307: connect: Connection refused (error 111)
I20260809 12:08:30.005795 12120 leader_election.cc:302] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 061d8c3603f14343920d858e640b9dfd; no voters: 1e38ce37027547efa06785b9247f59bc, abee08c3147547cc8f3379b5fc437835
I20260809 12:08:30.006029 16182 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 061d8c3603f14343920d858e640b9dfd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260809 12:08:30.935262 12084 master_runner.cc:186] Error getting master registration for 127.8.15.126:45327: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111),
I20260809 12:08:30.935523 12084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 12:08:31.534301 9527 heartbeater.cc:644] Failed to heartbeat to 127.8.15.126:45327 (557 consecutive failures): Network error: Failed to ping master at 127.8.15.126:45327: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:08:31.534361 9298 heartbeater.cc:644] Failed to heartbeat to 127.8.15.126:45327 (557 consecutive failures): Network error: Failed to ping master at 127.8.15.126:45327: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:08:31.930197 9782 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:08:31.930629 9782 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:08:31.930895 9782 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:08:31.931200 9782 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
W20260809 12:08:31.943984 9780 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.8.15.126:45327)
W20260809 12:08:31.944448 9780 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.8.15.126:45327)
F20260809 12:08:31.945814 9796 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a20494e2c08645f2b8321fd1681d3551 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
*** Check failure stack trace: ***
W20260809 12:08:31.946489 9780 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.8.15.126:45327)
F20260809 12:08:31.946508 9814 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.946780 9811 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
*** Check failure stack trace: ***
*** Aborted at 1786277311 (unix time) try "date -d @1786277311" if you are using GNU date ***
F20260809 12:08:31.946508 9814 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.946780 9811 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260809 12:08:31.946508 9814 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.946780 9811 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.947122 9802 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_19152f3d2b804962b678450f144cbb7e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260809 12:08:31.946508 9814 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.946780 9811 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.947122 9802 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_19152f3d2b804962b678450f144cbb7e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.949997 9820 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260809 12:08:31.946508 9814 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.946780 9811 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.947122 9802 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_19152f3d2b804962b678450f144cbb7e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.949997 9820 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.950398 9807 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260809 12:08:31.946508 9814 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.946780 9811 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.947122 9802 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_19152f3d2b804962b678450f144cbb7e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.949997 9820 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.950398 9807 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.950495 9816 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260809 12:08:31.946508 9814 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.946780 9811 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.947122 9802 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_19152f3d2b804962b678450f144cbb7e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.949997 9820 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.950398 9807 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.950495 9816 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.951869 9797 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_98748f90a4da4969b9f519b8b02d21a8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260809 12:08:31.946508 9814 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.946780 9811 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.947122 9802 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_19152f3d2b804962b678450f144cbb7e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.949997 9820 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.950398 9807 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.950495 9816 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.951869 9797 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_98748f90a4da4969b9f519b8b02d21a8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.952354 9791 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260809 12:08:31.952374 9810 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_23a7e0a1a33a491ea66728c96d558eef on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260809 12:08:31.946508 9814 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.946780 9811 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.947122 9802 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_19152f3d2b804962b678450f144cbb7e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.949997 9820 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.950398 9807 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.950495 9816 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.951869 9797 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_98748f90a4da4969b9f519b8b02d21a8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.952354 9791 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260809 12:08:31.952374 9810 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_23a7e0a1a33a491ea66728c96d558eef on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260809 12:08:31.946508 9814 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.946780 9811 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.947122 9802 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_19152f3d2b804962b678450f144cbb7e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.949997 9820 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.950398 9807 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.950495 9816 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.951869 9797 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_98748f90a4da4969b9f519b8b02d21a8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.952354 9791 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260809 12:08:31.952374 9810 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_23a7e0a1a33a491ea66728c96d558eef on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.952544 9817 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260809 12:08:31.946508 9814 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.946780 9811 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.947122 9802 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_19152f3d2b804962b678450f144cbb7e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.949997 9820 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.950398 9807 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.950495 9816 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.951869 9797 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_98748f90a4da4969b9f519b8b02d21a8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.952354 9791 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260809 12:08:31.952374 9810 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_23a7e0a1a33a491ea66728c96d558eef on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.952544 9817 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.953071 9798 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_20e68010fb344d51ae82c39f2a5b6520 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260809 12:08:31.946508 9814 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.946780 9811 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.947122 9802 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_19152f3d2b804962b678450f144cbb7e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.949997 9820 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.950398 9807 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.950495 9816 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.951869 9797 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_98748f90a4da4969b9f519b8b02d21a8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.952354 9791 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260809 12:08:31.952374 9810 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_23a7e0a1a33a491ea66728c96d558eef on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.952544 9817 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.953071 9798 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_20e68010fb344d51ae82c39f2a5b6520 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.953303 9806 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_32063c5c554f4148b27ed449777518f2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260809 12:08:31.946508 9814 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.946780 9811 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.947122 9802 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_19152f3d2b804962b678450f144cbb7e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.949997 9820 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.950398 9807 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.950495 9816 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.951869 9797 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_98748f90a4da4969b9f519b8b02d21a8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.952354 9791 master-stress-test.cc:329] Check failed: _s.ok() Bad status: F20260809 12:08:31.952374 9810 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_23a7e0a1a33a491ea66728c96d558eef on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.952544 9817 master-stress-test.cc:352] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.953071 9798 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_20e68010fb344d51ae82c39f2a5b6520 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.953303 9806 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_32063c5c554f4148b27ed449777518f2 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)F20260809 12:08:31.953068 9808 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.8.15.126:45327,127.8.15.125:37165,127.8.15.124:33307, num_attempts: 742) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.8.15.126:45327: connect: Connection refused (error 111)
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e80000203d) received by PID 8253 (TID 0x7f09435e1700) from PID 8253; stack trace: ***
@ 0x7f0952c72a46 google::(anonymous namespace)::FailureSignalHandler() at ??:0
@ 0x7f0956db4980 (unknown) at ??:0
@ 0x7f094ffa0e87 gsignal at ??:0
@ 0x7f094ffa27f1 abort at ??:0
@ 0x7f0952c649ad google::LogMessage::Fail() at ??:0
@ 0x7f0952c6788a google::LogMessage::SendToLog() at ??:0
@ 0x7f0952c644de google::LogMessage::Flush() at ??:0
@ 0x7f0952c65a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x403d42 kudu::MasterStressTest::CreateTableThread() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/master-stress-test.cc:298
@ 0x444b44 std::__invoke_impl<>() at /opt/rh/devtoolset-8/root/usr/lib/gcc/x86_64-redhat-linux/8/../../../../include/c++/8/bits/invoke.h:73
@ 0x4449fd std::__invoke<>() at /opt/rh/devtoolset-8/root/usr/lib/gcc/x86_64-redhat-linux/8/../../../../include/c++/8/bits/invoke.h:95
@ 0x4449ba _ZNSt6thread8_InvokerISt5tupleIJMN4kudu16MasterStressTestEFvvEPNS2_26MasterStressTest_Test_TestEEEE9_M_invokeIJLm0ELm1EEEEDTclsr3stdE8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at /opt/rh/devtoolset-8/root/usr/lib/gcc/x86_64-redhat-linux/8/../../../../include/c++/8/thread:244
@ 0x44496e std::thread::_Invoker<>::operator()() at /opt/rh/devtoolset-8/root/usr/lib/gcc/x86_64-redhat-linux/8/../../../../include/c++/8/thread:253
@ 0x4446a9 std::thread::_State_impl<>::_M_run() at /opt/rh/devtoolset-8/root/usr/lib/gcc/x86_64-redhat-linux/8/../../../../include/c++/8/thread:196
@ 0x7f095b6f0a4f execute_native_thread_routine at ??:0
@ 0x7f0956da96db start_thread at ??:0
@ 0x7f095008361f clone at ??:0