Note: This is test shard 3 of 3.
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/2
2026-08-12T01:50:17Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T01:50:17Z Disabled control of system clock
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskOMow7D/thirdparty/installed/common/opt/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskOMow7D/thirdparty/installed/common/opt/hadoop/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL: jdbc:derby:/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/metadb;create=true
Metastore Connection Driver : org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User: APP
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.derby.sql
Initialization script completed
schemaTool completed
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/security.properties
2026-08-12 01:50:25: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskOMow7D/thirdparty/installed/common/opt/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskOMow7D/thirdparty/installed/common/opt/hadoop/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Starting hive metastore on port 0
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260812 01:50:34.712299 12236 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskOMow7D/build/asan/bin/kudu
/tmp/dist-test-taskOMow7D/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.243.62:40769
--webserver_interface=127.11.243.62
--webserver_port=0
--builtin_ntp_servers=127.11.243.20:42563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--hive_metastore_uris=thrift://127.0.0.1:35039
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260812 01:50:35.171517 12583 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:50:35.171914 12583 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:50:35.172073 12583 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 01:50:35.181216 12583 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:50:35.181344 12583 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:50:35.181453 12583 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:50:35.181550 12583 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:50:35.192524 12583 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.243.20:42563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:35039
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.243.62:40769
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.243.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 1d9153c248733781bf69132f2d094d9d3c92b2bc
build type FASTDEBUG
built by None at 12 Aug 2026 01:45:57 UTC on bdcb31816ec0
build id 13298
ASAN enabled
I20260812 01:50:35.195051 12583 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:50:35.198045 12583 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 01:50:35.217449 12588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:50:35.217435 12589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:50:35.220415 12591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:50:35.221046 12583 server_base.cc:1061] running on GCE node
I20260812 01:50:35.222465 12583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:50:35.225054 12583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:50:35.226477 12583 hybrid_clock.cc:648] HybridClock initialized: now 1786499435226400 us; error 118 us; skew 500 ppm
I20260812 01:50:35.227016 12583 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:50:35.230754 12583 webserver.cc:533] Webserver started at http://127.11.243.62:41749/ using document root <none> and password file <none>
I20260812 01:50:35.232605 12583 fs_manager.cc:362] Metadata directory not provided
I20260812 01:50:35.232807 12583 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:50:35.233544 12583 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:50:35.238770 12583 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/data/instance:
uuid: "164a9e4e737b442f974a0af80ccce066"
format_stamp: "Formatted at 2026-08-12 01:50:35 on dist-test-slave-9gcw"
I20260812 01:50:35.239908 12583 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/wal/instance:
uuid: "164a9e4e737b442f974a0af80ccce066"
format_stamp: "Formatted at 2026-08-12 01:50:35 on dist-test-slave-9gcw"
I20260812 01:50:35.249394 12583 fs_manager.cc:696] Time spent creating directory manager: real 0.009s user 0.011s sys 0.000s
I20260812 01:50:35.256044 12597 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:50:35.258761 12583 fs_manager.cc:730] Time spent opening block manager: real 0.006s user 0.006s sys 0.000s
I20260812 01:50:35.259092 12583 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/data,/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/wal
uuid: "164a9e4e737b442f974a0af80ccce066"
format_stamp: "Formatted at 2026-08-12 01:50:35 on dist-test-slave-9gcw"
I20260812 01:50:35.259563 12583 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:50:35.278514 12583 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260812 01:50:35.279768 12583 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:50:35.280176 12583 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:50:35.312628 12656 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.243.62:40769 every 8 connection(s)
I20260812 01:50:35.312647 12583 rpc_server.cc:307] RPC server started. Bound to: 127.11.243.62:40769
I20260812 01:50:35.315701 12583 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/data/info.pb
I20260812 01:50:35.318768 12236 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskOMow7D/build/asan/bin/kudu as pid 12583
I20260812 01:50:35.319146 12236 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/wal/instance
I20260812 01:50:35.322347 12236 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskOMow7D/build/asan/bin/kudu
/tmp/dist-test-taskOMow7D/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.243.61:40289
--webserver_interface=127.11.243.61
--webserver_port=0
--builtin_ntp_servers=127.11.243.20:42563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--hive_metastore_uris=thrift://127.0.0.1:35039
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260812 01:50:35.325943 12658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:35.336313 12658 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:50:35.373010 12658 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } has no permanent_uuid. Determining permanent_uuid...
W20260812 01:50:35.374465 12601 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
W20260812 01:50:35.376598 12658 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.243.61:40289: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:50:35.426064 12658 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } attempt: 1
W20260812 01:50:35.428454 12658 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.243.61:40289: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:50:35.496824 12658 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } attempt: 2
W20260812 01:50:35.499497 12658 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.243.61:40289: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:50:35.590845 12658 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } attempt: 3
W20260812 01:50:35.593331 12658 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.243.61:40289: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
W20260812 01:50:35.697232 12659 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:50:35.697616 12659 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:50:35.697764 12659 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 01:50:35.706580 12659 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:50:35.706693 12659 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:50:35.706789 12659 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:50:35.706887 12659 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:50:35.717404 12659 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.243.20:42563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:35039
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.243.61:40289
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.243.61
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 1d9153c248733781bf69132f2d094d9d3c92b2bc
build type FASTDEBUG
built by None at 12 Aug 2026 01:45:57 UTC on bdcb31816ec0
build id 13298
ASAN enabled
I20260812 01:50:35.719225 12659 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:50:35.721248 12659 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 01:50:35.731087 12668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:50:35.731141 12669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:50:35.731117 12671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:50:35.732187 12659 server_base.cc:1061] running on GCE node
I20260812 01:50:35.733008 12659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:50:35.734594 12659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:50:35.735911 12659 hybrid_clock.cc:648] HybridClock initialized: now 1786499435735851 us; error 44 us; skew 500 ppm
I20260812 01:50:35.736377 12659 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:50:35.736661 12658 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } attempt: 4
W20260812 01:50:35.739441 12658 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.243.61:40289: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:50:35.739532 12659 webserver.cc:533] Webserver started at http://127.11.243.61:46117/ using document root <none> and password file <none>
I20260812 01:50:35.740347 12659 fs_manager.cc:362] Metadata directory not provided
I20260812 01:50:35.740458 12659 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:50:35.740839 12659 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:50:35.743748 12659 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data/instance:
uuid: "d7fef830de08489da4a25fb34cfd9737"
format_stamp: "Formatted at 2026-08-12 01:50:35 on dist-test-slave-9gcw"
I20260812 01:50:35.744668 12659 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/wal/instance:
uuid: "d7fef830de08489da4a25fb34cfd9737"
format_stamp: "Formatted at 2026-08-12 01:50:35 on dist-test-slave-9gcw"
I20260812 01:50:35.750939 12659 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260812 01:50:35.754765 12677 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:50:35.756440 12659 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 01:50:35.756637 12659 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data,/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/wal
uuid: "d7fef830de08489da4a25fb34cfd9737"
format_stamp: "Formatted at 2026-08-12 01:50:35 on dist-test-slave-9gcw"
I20260812 01:50:35.756832 12659 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:50:35.788749 12659 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260812 01:50:35.789891 12659 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:50:35.790261 12659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:50:35.814790 12659 rpc_server.cc:307] RPC server started. Bound to: 127.11.243.61:40289
I20260812 01:50:35.814811 12742 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.243.61:40289 every 8 connection(s)
I20260812 01:50:35.816653 12659 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data/info.pb
I20260812 01:50:35.821697 12743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:35.824040 12236 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskOMow7D/build/asan/bin/kudu as pid 12659
I20260812 01:50:35.824298 12236 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/wal/instance
I20260812 01:50:35.825958 12236 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskOMow7D/build/asan/bin/kudu
/tmp/dist-test-taskOMow7D/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.243.60:33215
--webserver_interface=127.11.243.60
--webserver_port=0
--builtin_ntp_servers=127.11.243.20:42563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--hive_metastore_uris=thrift://127.0.0.1:35039
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260812 01:50:35.831720 12743 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:50:35.847843 12743 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:50:35.858397 12743 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } has no permanent_uuid. Determining permanent_uuid...
W20260812 01:50:35.859658 12683 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
W20260812 01:50:35.861625 12743 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.243.60:33215: Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
I20260812 01:50:35.911039 12743 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } attempt: 1
W20260812 01:50:35.913513 12743 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.243.60:33215: Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
I20260812 01:50:35.981853 12743 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } attempt: 2
W20260812 01:50:35.984220 12743 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.243.60:33215: Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
I20260812 01:50:36.038777 12658 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } attempt: 5
I20260812 01:50:36.046931 12658 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } has no permanent_uuid. Determining permanent_uuid...
W20260812 01:50:36.049171 12658 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.243.60:33215: Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
I20260812 01:50:36.075553 12743 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } attempt: 3
W20260812 01:50:36.078083 12743 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.243.60:33215: Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
I20260812 01:50:36.100445 12658 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } attempt: 1
W20260812 01:50:36.102972 12658 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.243.60:33215: Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
I20260812 01:50:36.171267 12658 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } attempt: 2
W20260812 01:50:36.173549 12658 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.243.60:33215: Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
W20260812 01:50:36.191282 12744 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:50:36.191633 12744 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:50:36.191702 12744 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 01:50:36.201836 12744 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:50:36.201957 12744 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:50:36.202057 12744 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:50:36.202162 12744 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:50:36.215508 12744 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.243.20:42563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:35039
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.243.60:33215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.243.60
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 1d9153c248733781bf69132f2d094d9d3c92b2bc
build type FASTDEBUG
built by None at 12 Aug 2026 01:45:57 UTC on bdcb31816ec0
build id 13298
ASAN enabled
I20260812 01:50:36.217650 12744 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:50:36.219743 12744 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260812 01:50:36.221360 12743 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } attempt: 4
W20260812 01:50:36.223559 12743 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.243.60:33215: Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
W20260812 01:50:36.229949 12753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:50:36.229934 12755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:50:36.230851 12758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:50:36.230911 12744 server_base.cc:1061] running on GCE node
I20260812 01:50:36.231748 12744 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:50:36.233414 12744 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:50:36.234679 12744 hybrid_clock.cc:648] HybridClock initialized: now 1786499436234639 us; error 29 us; skew 500 ppm
I20260812 01:50:36.235121 12744 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:50:36.237531 12744 webserver.cc:533] Webserver started at http://127.11.243.60:45607/ using document root <none> and password file <none>
I20260812 01:50:36.238353 12744 fs_manager.cc:362] Metadata directory not provided
I20260812 01:50:36.238484 12744 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:50:36.238874 12744 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:50:36.241446 12744 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data/instance:
uuid: "a29998df1d9d480691e9c2654ae50c94"
format_stamp: "Formatted at 2026-08-12 01:50:36 on dist-test-slave-9gcw"
I20260812 01:50:36.242295 12744 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/wal/instance:
uuid: "a29998df1d9d480691e9c2654ae50c94"
format_stamp: "Formatted at 2026-08-12 01:50:36 on dist-test-slave-9gcw"
I20260812 01:50:36.248060 12744 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 01:50:36.252367 12768 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:50:36.253966 12744 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:50:36.254173 12744 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data,/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/wal
uuid: "a29998df1d9d480691e9c2654ae50c94"
format_stamp: "Formatted at 2026-08-12 01:50:36 on dist-test-slave-9gcw"
I20260812 01:50:36.254416 12744 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:50:36.273425 12744 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260812 01:50:36.274470 12744 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:50:36.274791 12744 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:50:36.279817 12658 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } attempt: 3
W20260812 01:50:36.282243 12658 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.243.60:33215: Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
I20260812 01:50:36.298375 12744 rpc_server.cc:307] RPC server started. Bound to: 127.11.243.60:33215
I20260812 01:50:36.298390 12836 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.243.60:33215 every 8 connection(s)
I20260812 01:50:36.300050 12744 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data/info.pb
I20260812 01:50:36.304665 12837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:36.309532 12236 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskOMow7D/build/asan/bin/kudu as pid 12744
I20260812 01:50:36.309739 12236 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/wal/instance
I20260812 01:50:36.311978 12837 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:50:36.333307 12837 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:50:36.342593 12837 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } has no permanent_uuid. Determining permanent_uuid...
I20260812 01:50:36.360455 12837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: Bootstrap starting.
I20260812 01:50:36.367301 12837 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:36.369520 12837 log.cc:826] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: Log is configured to *not* fsync() on all Append() calls
I20260812 01:50:36.373272 12837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: No bootstrap required, opened a new log
I20260812 01:50:36.380517 12837 raft_consensus.cc:359] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:36.380970 12837 raft_consensus.cc:385] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:36.381259 12837 raft_consensus.cc:740] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29998df1d9d480691e9c2654ae50c94, State: Initialized, Role: FOLLOWER
I20260812 01:50:36.382709 12837 consensus_queue.cc:260] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:36.384096 12845 sys_catalog.cc:455] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:36.384408 12845 sys_catalog.cc:458] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:50:36.385907 12837 sys_catalog.cc:565] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 01:50:36.405126 12866 catalog_manager.cc:1594] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 01:50:36.405503 12866 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 01:50:36.398485 12744 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: OK, instance_id { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" instance_seqno: 1786499435304992 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 01:50:36.410231 12744 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:50:36.459462 12658 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } attempt: 4
I20260812 01:50:36.475698 12658 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066: Bootstrap starting.
I20260812 01:50:36.480207 12658 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:36.481881 12658 log.cc:826] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066: Log is configured to *not* fsync() on all Append() calls
I20260812 01:50:36.492121 12658 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066: No bootstrap required, opened a new log
I20260812 01:50:36.501089 12658 raft_consensus.cc:359] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:36.501753 12658 raft_consensus.cc:385] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:36.501986 12658 raft_consensus.cc:740] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164a9e4e737b442f974a0af80ccce066, State: Initialized, Role: FOLLOWER
I20260812 01:50:36.503027 12658 consensus_queue.cc:260] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:36.506544 12845 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:36.506875 12845 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:36.509892 12873 sys_catalog.cc:455] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:36.510113 12845 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
I20260812 01:50:36.510375 12873 sys_catalog.cc:458] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:50:36.513269 12658 sys_catalog.cc:565] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:50:36.513216 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a29998df1d9d480691e9c2654ae50c94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164a9e4e737b442f974a0af80ccce066" is_pre_election: true
I20260812 01:50:36.514180 12628 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29998df1d9d480691e9c2654ae50c94 in term 0.
I20260812 01:50:36.515192 12773 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164a9e4e737b442f974a0af80ccce066, a29998df1d9d480691e9c2654ae50c94; no voters:
I20260812 01:50:36.515837 12845 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:50:36.516021 12845 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:50:36.516161 12845 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:36.522814 12743 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } attempt: 5
I20260812 01:50:36.524808 12845 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
W20260812 01:50:36.528524 12775 tablet.cc:2406] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:50:36.530220 12845 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 1 election: Requested vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
I20260812 01:50:36.530871 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a29998df1d9d480691e9c2654ae50c94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164a9e4e737b442f974a0af80ccce066"
I20260812 01:50:36.531143 12628 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 0 FOLLOWER]: Advancing to term 1
W20260812 01:50:36.534401 12603 tablet.cc:2406] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:50:36.534665 12628 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29998df1d9d480691e9c2654ae50c94 in term 1.
I20260812 01:50:36.535566 12773 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164a9e4e737b442f974a0af80ccce066, a29998df1d9d480691e9c2654ae50c94; no voters:
I20260812 01:50:36.536477 12845 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:50:36.550617 12743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: Bootstrap starting.
I20260812 01:50:36.562460 12845 raft_consensus.cc:697] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 1 LEADER]: Becoming Leader. State: Replica: a29998df1d9d480691e9c2654ae50c94, State: Running, Role: LEADER
I20260812 01:50:36.563385 12845 consensus_queue.cc:237] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:36.566805 12743 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:36.570766 12878 sys_catalog.cc:455] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a29998df1d9d480691e9c2654ae50c94. Latest consensus state: current_term: 1 leader_uuid: "a29998df1d9d480691e9c2654ae50c94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:36.571257 12878 sys_catalog.cc:458] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: This master's current role is: LEADER
I20260812 01:50:36.573678 12881 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 01:50:36.574499 12743 log.cc:826] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: Log is configured to *not* fsync() on all Append() calls
I20260812 01:50:36.583920 12881 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 01:50:36.588956 12743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: No bootstrap required, opened a new log
I20260812 01:50:36.599006 12743 raft_consensus.cc:359] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:36.599464 12743 raft_consensus.cc:385] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:36.599639 12743 raft_consensus.cc:740] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fef830de08489da4a25fb34cfd9737, State: Initialized, Role: FOLLOWER
I20260812 01:50:36.600696 12743 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:36.620849 12889 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:36.621379 12889 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:50:36.621779 12889 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:36.622020 12889 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:36.627206 12628 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 1 FOLLOWER]: Refusing update from remote peer a29998df1d9d480691e9c2654ae50c94: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:50:36.628782 12878 consensus_queue.cc:1048] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:50:36.633972 12743 sys_catalog.cc:565] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:50:36.634049 12713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a29998df1d9d480691e9c2654ae50c94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fef830de08489da4a25fb34cfd9737" is_pre_election: true
I20260812 01:50:36.634661 12713 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29998df1d9d480691e9c2654ae50c94 in term 0.
I20260812 01:50:36.636224 12710 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:36.637679 12889 leader_election.cc:290] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
I20260812 01:50:36.637807 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7fef830de08489da4a25fb34cfd9737" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a29998df1d9d480691e9c2654ae50c94" is_pre_election: true
I20260812 01:50:36.638134 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7fef830de08489da4a25fb34cfd9737" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164a9e4e737b442f974a0af80ccce066" is_pre_election: true
I20260812 01:50:36.643374 12684 leader_election.cc:304] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fef830de08489da4a25fb34cfd9737; no voters: 164a9e4e737b442f974a0af80ccce066, a29998df1d9d480691e9c2654ae50c94
I20260812 01:50:36.643947 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a29998df1d9d480691e9c2654ae50c94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fef830de08489da4a25fb34cfd9737"
I20260812 01:50:36.646842 12710 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 1 FOLLOWER]: Refusing update from remote peer a29998df1d9d480691e9c2654ae50c94: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 01:50:36.647919 12889 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 01:50:36.647851 12878 consensus_queue.cc:1048] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:50:36.657958 12889 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a29998df1d9d480691e9c2654ae50c94. Latest consensus state: current_term: 1 leader_uuid: "a29998df1d9d480691e9c2654ae50c94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:36.658263 12889 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:50:36.672103 12878 sys_catalog.cc:455] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a29998df1d9d480691e9c2654ae50c94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:36.672459 12878 sys_catalog.cc:458] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: This master's current role is: LEADER
I20260812 01:50:36.676082 12889 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a29998df1d9d480691e9c2654ae50c94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:36.676404 12889 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:50:36.680112 12881 catalog_manager.cc:1383] Generated new cluster ID: 4d89e47244e04cbeb6aca21d5d476cc2
I20260812 01:50:36.680316 12881 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 01:50:36.688628 12921 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 01:50:36.688040 12659 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: OK, instance_id { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" instance_seqno: 1786499435304992 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 01:50:36.695830 12659 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:50:36.697043 12873 sys_catalog.cc:455] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a29998df1d9d480691e9c2654ae50c94. Latest consensus state: current_term: 1 leader_uuid: "a29998df1d9d480691e9c2654ae50c94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:36.697320 12873 sys_catalog.cc:458] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:50:36.703497 12845 sys_catalog.cc:455] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a29998df1d9d480691e9c2654ae50c94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:36.704126 12845 sys_catalog.cc:458] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: This master's current role is: LEADER
I20260812 01:50:36.718346 12881 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 01:50:36.721089 12881 catalog_manager.cc:1540] Loading token signing keys...
I20260812 01:50:36.730844 12873 sys_catalog.cc:455] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a29998df1d9d480691e9c2654ae50c94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:36.731117 12873 sys_catalog.cc:458] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:50:36.737069 12930 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 01:50:36.764904 12881 catalog_manager.cc:6092] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: Generated new TSK 0
I20260812 01:50:36.766255 12881 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 01:50:36.767645 12881 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260812 01:50:36.768644 12881 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: -1
I20260812 01:50:36.794806 12236 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskOMow7D/build/asan/bin/kudu
/tmp/dist-test-taskOMow7D/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.243.1:0
--local_ip_for_outbound_sockets=127.11.243.1
--webserver_interface=127.11.243.1
--webserver_port=0
--tserver_master_addrs=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--builtin_ntp_servers=127.11.243.20:42563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260812 01:50:37.182384 12932 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:50:37.182816 12932 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:50:37.182987 12932 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 01:50:37.193640 12932 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:50:37.193908 12932 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.243.1
I20260812 01:50:37.205693 12932 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.243.20:42563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.243.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.243.1
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.243.1
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 1d9153c248733781bf69132f2d094d9d3c92b2bc
build type FASTDEBUG
built by None at 12 Aug 2026 01:45:57 UTC on bdcb31816ec0
build id 13298
ASAN enabled
I20260812 01:50:37.207427 12932 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:50:37.209461 12932 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 01:50:37.220942 12942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:50:37.221478 12941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:50:37.221519 12944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:50:37.222466 12932 server_base.cc:1061] running on GCE node
I20260812 01:50:37.223145 12932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:50:37.224238 12932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:50:37.225484 12932 hybrid_clock.cc:648] HybridClock initialized: now 1786499437225444 us; error 76 us; skew 500 ppm
I20260812 01:50:37.225871 12932 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:50:37.228410 12932 webserver.cc:533] Webserver started at http://127.11.243.1:35127/ using document root <none> and password file <none>
I20260812 01:50:37.229315 12932 fs_manager.cc:362] Metadata directory not provided
I20260812 01:50:37.229475 12932 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:50:37.229993 12932 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:50:37.232707 12932 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-0/data/instance:
uuid: "3fa1f2b1b9b548df97a1878bfde765b5"
format_stamp: "Formatted at 2026-08-12 01:50:37 on dist-test-slave-9gcw"
I20260812 01:50:37.233547 12932 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-0/wal/instance:
uuid: "3fa1f2b1b9b548df97a1878bfde765b5"
format_stamp: "Formatted at 2026-08-12 01:50:37 on dist-test-slave-9gcw"
I20260812 01:50:37.239379 12932 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 01:50:37.243073 12950 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:50:37.244707 12932 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 01:50:37.244916 12932 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-0/wal
uuid: "3fa1f2b1b9b548df97a1878bfde765b5"
format_stamp: "Formatted at 2026-08-12 01:50:37 on dist-test-slave-9gcw"
I20260812 01:50:37.245210 12932 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:50:37.260310 12932 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260812 01:50:37.261351 12932 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:50:37.261677 12932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:50:37.263002 12932 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 01:50:37.265101 12957 raft_consensus.cc:493] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29998df1d9d480691e9c2654ae50c94)
I20260812 01:50:37.265488 12957 raft_consensus.cc:515] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:37.265797 12932 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:50:37.266021 12932 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:50:37.266206 12932 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 01:50:37.266346 12932 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:50:37.267228 12957 leader_election.cc:290] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
I20260812 01:50:37.267913 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "164a9e4e737b442f974a0af80ccce066" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7fef830de08489da4a25fb34cfd9737" is_pre_election: true
I20260812 01:50:37.267916 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "164a9e4e737b442f974a0af80ccce066" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29998df1d9d480691e9c2654ae50c94" is_pre_election: true
I20260812 01:50:37.268795 12600 leader_election.cc:304] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164a9e4e737b442f974a0af80ccce066; no voters: a29998df1d9d480691e9c2654ae50c94, d7fef830de08489da4a25fb34cfd9737
I20260812 01:50:37.269305 12957 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 01:50:37.306831 12932 rpc_server.cc:307] RPC server started. Bound to: 127.11.243.1:42765
I20260812 01:50:37.306941 13089 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.243.1:42765 every 8 connection(s)
I20260812 01:50:37.308465 12932 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-0/data/info.pb
I20260812 01:50:37.308921 12236 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskOMow7D/build/asan/bin/kudu as pid 12932
I20260812 01:50:37.309190 12236 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-0/wal/instance
I20260812 01:50:37.320076 12236 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskOMow7D/build/asan/bin/kudu
/tmp/dist-test-taskOMow7D/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.243.2:0
--local_ip_for_outbound_sockets=127.11.243.2
--webserver_interface=127.11.243.2
--webserver_port=0
--tserver_master_addrs=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--builtin_ntp_servers=127.11.243.20:42563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 01:50:37.348953 13092 heartbeater.cc:344] Connected to a master server at 127.11.243.62:40769
I20260812 01:50:37.349570 13092 heartbeater.cc:461] Registering TS with master...
I20260812 01:50:37.351042 13092 heartbeater.cc:507] Master 127.11.243.62:40769 requested a full tablet report, sending...
I20260812 01:50:37.356560 12615 ts_manager.cc:194] Registered new tserver with Master: 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765)
I20260812 01:50:37.360875 13094 heartbeater.cc:344] Connected to a master server at 127.11.243.61:40289
I20260812 01:50:37.361039 13094 heartbeater.cc:461] Registering TS with master...
I20260812 01:50:37.361716 13094 heartbeater.cc:507] Master 127.11.243.61:40289 requested a full tablet report, sending...
I20260812 01:50:37.362636 13090 heartbeater.cc:344] Connected to a master server at 127.11.243.60:33215
I20260812 01:50:37.362780 13090 heartbeater.cc:461] Registering TS with master...
I20260812 01:50:37.363159 13090 heartbeater.cc:507] Master 127.11.243.60:33215 requested a full tablet report, sending...
I20260812 01:50:37.364218 12700 ts_manager.cc:194] Registered new tserver with Master: 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765)
I20260812 01:50:37.364796 12790 ts_manager.cc:194] Registered new tserver with Master: 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765)
I20260812 01:50:37.367863 12790 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.11.243.1:36561
I20260812 01:50:37.694397 12921 catalog_manager.cc:1295] Loaded cluster ID: 4d89e47244e04cbeb6aca21d5d476cc2
I20260812 01:50:37.694758 12921 catalog_manager.cc:1588] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: loading cluster ID for follower catalog manager: success
I20260812 01:50:37.699390 12921 catalog_manager.cc:1610] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: acquiring CA information for follower catalog manager: success
I20260812 01:50:37.702258 12921 catalog_manager.cc:1638] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 01:50:37.702816 13103 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29998df1d9d480691e9c2654ae50c94)
I20260812 01:50:37.703027 13103 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:37.703956 13103 leader_election.cc:290] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
I20260812 01:50:37.704631 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7fef830de08489da4a25fb34cfd9737" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164a9e4e737b442f974a0af80ccce066" is_pre_election: true
I20260812 01:50:37.704895 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7fef830de08489da4a25fb34cfd9737" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29998df1d9d480691e9c2654ae50c94" is_pre_election: true
I20260812 01:50:37.705775 12683 leader_election.cc:304] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fef830de08489da4a25fb34cfd9737; no voters: 164a9e4e737b442f974a0af80ccce066, a29998df1d9d480691e9c2654ae50c94
I20260812 01:50:37.706156 13103 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 01:50:37.744253 12930 catalog_manager.cc:1295] Loaded cluster ID: 4d89e47244e04cbeb6aca21d5d476cc2
I20260812 01:50:37.744505 12930 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066: loading cluster ID for follower catalog manager: success
I20260812 01:50:37.749260 12930 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066: acquiring CA information for follower catalog manager: success
I20260812 01:50:37.752472 12930 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 01:50:37.765167 13098 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:50:37.765676 13098 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:50:37.765902 13098 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 01:50:37.777311 13098 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:50:37.777621 13098 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.243.2
I20260812 01:50:37.792706 13098 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.243.20:42563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.243.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.243.2
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.243.2
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 1d9153c248733781bf69132f2d094d9d3c92b2bc
build type FASTDEBUG
built by None at 12 Aug 2026 01:45:57 UTC on bdcb31816ec0
build id 13298
ASAN enabled
I20260812 01:50:37.795671 13098 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:50:37.798472 13098 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 01:50:37.811381 13109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:50:37.813808 13110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:50:37.815699 13114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:50:37.818305 13098 server_base.cc:1061] running on GCE node
I20260812 01:50:37.819121 13098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:50:37.834182 13098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:50:37.835863 13098 hybrid_clock.cc:648] HybridClock initialized: now 1786499437835700 us; error 92 us; skew 500 ppm
I20260812 01:50:37.836395 13098 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:50:37.840951 13098 webserver.cc:533] Webserver started at http://127.11.243.2:44695/ using document root <none> and password file <none>
I20260812 01:50:37.842314 13098 fs_manager.cc:362] Metadata directory not provided
I20260812 01:50:37.842563 13098 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:50:37.843156 13098 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:50:37.847536 13098 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-1/data/instance:
uuid: "e0adecc3c8034b71923a3a23c38549a9"
format_stamp: "Formatted at 2026-08-12 01:50:37 on dist-test-slave-9gcw"
I20260812 01:50:37.848876 13098 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-1/wal/instance:
uuid: "e0adecc3c8034b71923a3a23c38549a9"
format_stamp: "Formatted at 2026-08-12 01:50:37 on dist-test-slave-9gcw"
I20260812 01:50:37.857402 13098 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.006s sys 0.001s
I20260812 01:50:37.864554 13122 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:50:37.867055 13098 fs_manager.cc:730] Time spent opening block manager: real 0.006s user 0.007s sys 0.000s
I20260812 01:50:37.867278 13098 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-1/wal
uuid: "e0adecc3c8034b71923a3a23c38549a9"
format_stamp: "Formatted at 2026-08-12 01:50:37 on dist-test-slave-9gcw"
I20260812 01:50:37.867689 13098 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:50:37.871551 13090 heartbeater.cc:499] Master 127.11.243.60:33215 was elected leader, sending a full tablet report...
I20260812 01:50:37.915995 13098 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260812 01:50:37.917526 13098 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:50:37.918081 13098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:50:37.920022 13098 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 01:50:37.923383 13098 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:50:37.923578 13098 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:50:37.923746 13098 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 01:50:37.923877 13098 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:50:38.009936 13098 rpc_server.cc:307] RPC server started. Bound to: 127.11.243.2:35853
I20260812 01:50:38.009996 13252 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.243.2:35853 every 8 connection(s)
I20260812 01:50:38.012219 13098 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-1/data/info.pb
I20260812 01:50:38.022651 12236 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskOMow7D/build/asan/bin/kudu as pid 13098
I20260812 01:50:38.022891 12236 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-1/wal/instance
I20260812 01:50:38.029129 12236 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskOMow7D/build/asan/bin/kudu
/tmp/dist-test-taskOMow7D/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.243.3:0
--local_ip_for_outbound_sockets=127.11.243.3
--webserver_interface=127.11.243.3
--webserver_port=0
--tserver_master_addrs=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--builtin_ntp_servers=127.11.243.20:42563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 01:50:38.067361 13253 heartbeater.cc:344] Connected to a master server at 127.11.243.60:33215
I20260812 01:50:38.067910 13253 heartbeater.cc:461] Registering TS with master...
I20260812 01:50:38.074795 13253 heartbeater.cc:507] Master 127.11.243.60:33215 requested a full tablet report, sending...
I20260812 01:50:38.077773 12790 ts_manager.cc:194] Registered new tserver with Master: e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853)
I20260812 01:50:38.079275 12790 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.11.243.2:56173
I20260812 01:50:38.083779 13254 heartbeater.cc:344] Connected to a master server at 127.11.243.62:40769
I20260812 01:50:38.084024 13254 heartbeater.cc:461] Registering TS with master...
I20260812 01:50:38.084604 13254 heartbeater.cc:507] Master 127.11.243.62:40769 requested a full tablet report, sending...
I20260812 01:50:38.086196 12615 ts_manager.cc:194] Registered new tserver with Master: e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853)
I20260812 01:50:38.092599 13257 heartbeater.cc:344] Connected to a master server at 127.11.243.61:40289
I20260812 01:50:38.092800 13257 heartbeater.cc:461] Registering TS with master...
I20260812 01:50:38.093272 13257 heartbeater.cc:507] Master 127.11.243.61:40289 requested a full tablet report, sending...
I20260812 01:50:38.094794 12700 ts_manager.cc:194] Registered new tserver with Master: e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853)
I20260812 01:50:38.272821 13264 raft_consensus.cc:493] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29998df1d9d480691e9c2654ae50c94)
I20260812 01:50:38.274029 13264 raft_consensus.cc:515] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:38.278765 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "164a9e4e737b442f974a0af80ccce066" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7fef830de08489da4a25fb34cfd9737" is_pre_election: true
I20260812 01:50:38.280539 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "164a9e4e737b442f974a0af80ccce066" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29998df1d9d480691e9c2654ae50c94" is_pre_election: true
I20260812 01:50:38.281854 12600 leader_election.cc:304] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164a9e4e737b442f974a0af80ccce066; no voters: a29998df1d9d480691e9c2654ae50c94, d7fef830de08489da4a25fb34cfd9737
I20260812 01:50:38.283035 13264 leader_election.cc:290] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
I20260812 01:50:38.283797 13264 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 01:50:38.329705 13267 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29998df1d9d480691e9c2654ae50c94)
I20260812 01:50:38.330093 13267 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:38.331875 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7fef830de08489da4a25fb34cfd9737" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164a9e4e737b442f974a0af80ccce066" is_pre_election: true
I20260812 01:50:38.333701 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7fef830de08489da4a25fb34cfd9737" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a29998df1d9d480691e9c2654ae50c94" is_pre_election: true
I20260812 01:50:38.335031 12683 leader_election.cc:304] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fef830de08489da4a25fb34cfd9737; no voters: 164a9e4e737b442f974a0af80ccce066, a29998df1d9d480691e9c2654ae50c94
I20260812 01:50:38.336820 13267 leader_election.cc:290] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
I20260812 01:50:38.337368 13267 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 01:50:38.583889 13253 heartbeater.cc:499] Master 127.11.243.60:33215 was elected leader, sending a full tablet report...
W20260812 01:50:38.707911 13262 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:50:38.708362 13262 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:50:38.708534 13262 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 01:50:38.718588 13262 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:50:38.718889 13262 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.243.3
I20260812 01:50:38.731015 13262 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.243.20:42563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.243.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.243.3
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.243.3
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 1d9153c248733781bf69132f2d094d9d3c92b2bc
build type FASTDEBUG
built by None at 12 Aug 2026 01:45:57 UTC on bdcb31816ec0
build id 13298
ASAN enabled
I20260812 01:50:38.732874 13262 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:50:38.734984 13262 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 01:50:38.748023 13274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:50:38.748178 13273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:50:38.749917 13276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:50:38.750634 13262 server_base.cc:1061] running on GCE node
I20260812 01:50:38.751533 13262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:50:38.752728 13262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:50:38.753995 13262 hybrid_clock.cc:648] HybridClock initialized: now 1786499438753920 us; error 56 us; skew 500 ppm
I20260812 01:50:38.754387 13262 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:50:38.756971 13262 webserver.cc:533] Webserver started at http://127.11.243.3:38015/ using document root <none> and password file <none>
I20260812 01:50:38.757893 13262 fs_manager.cc:362] Metadata directory not provided
I20260812 01:50:38.758044 13262 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:50:38.758550 13262 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 01:50:38.761677 13262 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-2/data/instance:
uuid: "0ced0a6dbcf2486183c801a3a84594d0"
format_stamp: "Formatted at 2026-08-12 01:50:38 on dist-test-slave-9gcw"
I20260812 01:50:38.762728 13262 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-2/wal/instance:
uuid: "0ced0a6dbcf2486183c801a3a84594d0"
format_stamp: "Formatted at 2026-08-12 01:50:38 on dist-test-slave-9gcw"
I20260812 01:50:38.769287 13262 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 01:50:38.773362 13284 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:50:38.774834 13262 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 01:50:38.775038 13262 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-2/wal
uuid: "0ced0a6dbcf2486183c801a3a84594d0"
format_stamp: "Formatted at 2026-08-12 01:50:38 on dist-test-slave-9gcw"
I20260812 01:50:38.775293 13262 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:50:38.806231 13262 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260812 01:50:38.807345 13262 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:50:38.807770 13262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:50:38.809090 13262 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 01:50:38.811472 13262 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 01:50:38.811632 13262 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 01:50:38.811736 13262 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 01:50:38.811815 13262 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 01:50:38.872532 13262 rpc_server.cc:307] RPC server started. Bound to: 127.11.243.3:38197
I20260812 01:50:38.872726 13418 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.243.3:38197 every 8 connection(s)
I20260812 01:50:38.874383 13262 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-2/data/info.pb
I20260812 01:50:38.881085 12236 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskOMow7D/build/asan/bin/kudu as pid 13262
I20260812 01:50:38.881443 12236 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-2/wal/instance
I20260812 01:50:38.905576 13423 heartbeater.cc:344] Connected to a master server at 127.11.243.61:40289
I20260812 01:50:38.906149 13423 heartbeater.cc:461] Registering TS with master...
I20260812 01:50:38.906208 13419 heartbeater.cc:344] Connected to a master server at 127.11.243.60:33215
I20260812 01:50:38.906322 13421 heartbeater.cc:344] Connected to a master server at 127.11.243.62:40769
I20260812 01:50:38.906368 13419 heartbeater.cc:461] Registering TS with master...
I20260812 01:50:38.906519 13421 heartbeater.cc:461] Registering TS with master...
I20260812 01:50:38.907693 13423 heartbeater.cc:507] Master 127.11.243.61:40289 requested a full tablet report, sending...
I20260812 01:50:38.907853 13421 heartbeater.cc:507] Master 127.11.243.62:40769 requested a full tablet report, sending...
I20260812 01:50:38.907924 13419 heartbeater.cc:507] Master 127.11.243.60:33215 requested a full tablet report, sending...
I20260812 01:50:38.909876 12700 ts_manager.cc:194] Registered new tserver with Master: 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:50:38.909883 12615 ts_manager.cc:194] Registered new tserver with Master: 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:50:38.909916 12788 ts_manager.cc:194] Registered new tserver with Master: 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:50:38.911540 12788 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.11.243.3:51601
I20260812 01:50:38.927093 12236 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 01:50:38.997813 12790 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38938:
name: "default.Table_fce810b18eef421f8cb8d4fffce6a188"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:39.000717 12780 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38938:
name: "default.Table_05e4335fa3134a3495c1c0a5f1cd4313"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:38.997364 12788 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38938:
name: "default.Table_4827643389f34e8b941a8b303a91aedf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:38.999104 12787 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38938:
name: "default.Table_f6e57676e85d4df5b9e688ea19aa48f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:38.999610 12786 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38938:
name: "default.Table_8f0e075a075f49719ed6cce7b86a8fe8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:38.999867 12781 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38938:
name: "default.Table_6d36e1d186c948bf87645831e37e7b4d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:39.000077 12782 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38938:
name: "default.Table_9e18b143855f48a1ab04f0fbbb4a7130"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:39.008071 12779 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38938:
name: "default.Table_f04e78d3952146c88cb523c551527e23"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:39.010206 12778 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38938:
name: "default.Table_6896943d0549474caa2928d9fd085a3a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:39.013849 12777 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38938:
name: "default.Table_d3455b8ae1274ff0ab8eaf05f61734ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:50:39.018344 12790 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_fce810b18eef421f8cb8d4fffce6a188 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 01:50:39.025241 12779 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_f04e78d3952146c88cb523c551527e23 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 01:50:39.025228 12787 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_f6e57676e85d4df5b9e688ea19aa48f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 01:50:39.025493 12786 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_8f0e075a075f49719ed6cce7b86a8fe8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 01:50:39.025810 12782 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_9e18b143855f48a1ab04f0fbbb4a7130 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 01:50:39.028250 12781 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_6d36e1d186c948bf87645831e37e7b4d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 01:50:39.029450 12788 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_4827643389f34e8b941a8b303a91aedf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 01:50:39.025496 12780 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_05e4335fa3134a3495c1c0a5f1cd4313 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 01:50:39.028257 12778 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_6896943d0549474caa2928d9fd085a3a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 01:50:39.025230 12777 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_d3455b8ae1274ff0ab8eaf05f61734ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:50:39.043802 12236 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskOMow7D/build/asan/bin/kudu pid 12744
I20260812 01:50:39.045701 12831 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:50:39.227094 12236 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskOMow7D/build/asan/bin/kudu with pid 12744
W20260812 01:50:39.272953 13433 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.11.243.60:33215)
W20260812 01:50:39.277463 13253 heartbeater.cc:646] Failed to heartbeat to 127.11.243.60:33215 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.11.243.60:33215 (error 108)
W20260812 01:50:39.280512 13437 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 01:50:39.275231 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.11.243.60:33215 (local address 127.0.0.1:38942)
0812 01:50:39.276156 (+ 925us) negotiation.cc:107] Waiting for socket to connect
0812 01:50:39.276176 (+ 20us) client_negotiation.cc:175] Beginning negotiation
0812 01:50:39.276333 (+ 157us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0812 01:50:39.278811 (+ 2478us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":551}
I20260812 01:50:39.336671 13481 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29998df1d9d480691e9c2654ae50c94)
I20260812 01:50:39.336962 13481 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:39.338819 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7fef830de08489da4a25fb34cfd9737" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "164a9e4e737b442f974a0af80ccce066" is_pre_election: true
I20260812 01:50:39.345841 13481 leader_election.cc:290] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
W20260812 01:50:39.358894 12683 leader_election.cc:336] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215): Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
I20260812 01:50:39.359223 12683 leader_election.cc:304] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fef830de08489da4a25fb34cfd9737; no voters: 164a9e4e737b442f974a0af80ccce066, a29998df1d9d480691e9c2654ae50c94
I20260812 01:50:39.359681 13481 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 01:50:39.372295 13484 raft_consensus.cc:493] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a29998df1d9d480691e9c2654ae50c94)
I20260812 01:50:39.372614 13484 raft_consensus.cc:515] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:39.383467 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "164a9e4e737b442f974a0af80ccce066" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7fef830de08489da4a25fb34cfd9737" is_pre_election: true
I20260812 01:50:39.383832 12712 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164a9e4e737b442f974a0af80ccce066 in term 1.
I20260812 01:50:39.384250 13484 leader_election.cc:290] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
I20260812 01:50:39.384613 12601 leader_election.cc:304] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737; no voters:
W20260812 01:50:39.384871 13090 heartbeater.cc:646] Failed to heartbeat to 127.11.243.60:33215 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
I20260812 01:50:39.385075 13484 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 01:50:39.385311 13484 raft_consensus.cc:493] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a29998df1d9d480691e9c2654ae50c94)
I20260812 01:50:39.385495 13484 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 1 FOLLOWER]: Advancing to term 2
I20260812 01:50:39.388989 13484 raft_consensus.cc:515] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:39.390437 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "164a9e4e737b442f974a0af80ccce066" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d7fef830de08489da4a25fb34cfd9737"
I20260812 01:50:39.390671 12712 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 1 FOLLOWER]: Advancing to term 2
I20260812 01:50:39.393850 12712 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164a9e4e737b442f974a0af80ccce066 in term 2.
I20260812 01:50:39.394464 12601 leader_election.cc:304] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737; no voters:
W20260812 01:50:39.398605 12600 leader_election.cc:336] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215): Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
I20260812 01:50:39.399881 13484 leader_election.cc:290] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 2 election: Requested vote from peers d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
I20260812 01:50:39.401297 13484 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 01:50:39.401861 13484 raft_consensus.cc:697] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 2 LEADER]: Becoming Leader. State: Replica: 164a9e4e737b442f974a0af80ccce066, State: Running, Role: LEADER
W20260812 01:50:39.402361 12600 leader_election.cc:336] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215): Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
I20260812 01:50:39.402943 13484 consensus_queue.cc:237] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:39.412595 13488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 164a9e4e737b442f974a0af80ccce066. Latest consensus state: current_term: 2 leader_uuid: "164a9e4e737b442f974a0af80ccce066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:39.412976 13488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [sys.catalog]: This master's current role is: LEADER
I20260812 01:50:39.414224 13419 heartbeater.cc:499] Master 127.11.243.60:33215 was elected leader, sending a full tablet report...
W20260812 01:50:39.436910 13419 heartbeater.cc:646] Failed to heartbeat to 127.11.243.60:33215 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
I20260812 01:50:39.437994 13490 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 01:50:39.441620 13490 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 01:50:39.442924 13490 catalog_manager.cc:1295] Loaded cluster ID: 4d89e47244e04cbeb6aca21d5d476cc2
I20260812 01:50:39.443104 13490 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 01:50:39.444921 13490 catalog_manager.cc:1540] Loading token signing keys...
I20260812 01:50:39.446264 13490 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066: Loaded TSK: 0
I20260812 01:50:39.447747 13490 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 01:50:39.449796 13490 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260812 01:50:39.451193 13490 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: -1
I20260812 01:50:39.461279 12612 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_05e4335fa3134a3495c1c0a5f1cd4313"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:39.461862 12610 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_4827643389f34e8b941a8b303a91aedf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:39.462044 12614 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_6896943d0549474caa2928d9fd085a3a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:39.462224 12608 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_8f0e075a075f49719ed6cce7b86a8fe8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:39.462594 12606 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_6d36e1d186c948bf87645831e37e7b4d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:39.463104 12609 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_f6e57676e85d4df5b9e688ea19aa48f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:39.462656 12611 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_fce810b18eef421f8cb8d4fffce6a188"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:39.462322 12613 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_f04e78d3952146c88cb523c551527e23"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:39.461966 12607 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_9e18b143855f48a1ab04f0fbbb4a7130"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:39.461102 12615 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_d3455b8ae1274ff0ab8eaf05f61734ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 01:50:39.481572 12612 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_05e4335fa3134a3495c1c0a5f1cd4313 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:50:39.597483 12612 catalog_manager.cc:2200] created HMS catalog entry for table [id=51c4aa84d04240d3939355629be68e6c]
W20260812 01:50:39.611340 12610 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_4827643389f34e8b941a8b303a91aedf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 01:50:39.612818 12614 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_6896943d0549474caa2928d9fd085a3a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 01:50:39.613626 12607 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_9e18b143855f48a1ab04f0fbbb4a7130 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 01:50:39.614813 12613 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_f04e78d3952146c88cb523c551527e23 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 01:50:39.615674 12611 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_fce810b18eef421f8cb8d4fffce6a188 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 01:50:39.617597 12609 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_f6e57676e85d4df5b9e688ea19aa48f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 01:50:39.619526 12608 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_8f0e075a075f49719ed6cce7b86a8fe8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 01:50:39.620787 12606 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_6d36e1d186c948bf87645831e37e7b4d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 01:50:39.611347 12615 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_d3455b8ae1274ff0ab8eaf05f61734ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 01:50:39.623073 12712 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 2 FOLLOWER]: Refusing update from remote peer 164a9e4e737b442f974a0af80ccce066: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20260812 01:50:39.625341 13484 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260812 01:50:39.626960 12600 consensus_peers.cc:597] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 -> Peer a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215): Couldn't send request to peer a29998df1d9d480691e9c2654ae50c94. Status: Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 01:50:39.640218 13481 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 164a9e4e737b442f974a0af80ccce066. Latest consensus state: current_term: 2 leader_uuid: "164a9e4e737b442f974a0af80ccce066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:39.640491 13481 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:50:39.648048 13484 sys_catalog.cc:455] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "164a9e4e737b442f974a0af80ccce066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:39.648417 13484 sys_catalog.cc:458] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [sys.catalog]: This master's current role is: LEADER
I20260812 01:50:39.654217 12612 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_05e4335fa3134a3495c1c0a5f1cd4313" } new_table_name: "default.Table_4beba14d89f84ed5b3f67d5f527c4434" modify_external_catalogs: true
I20260812 01:50:39.655287 13481 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "164a9e4e737b442f974a0af80ccce066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:39.655591 13481 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:50:39.720767 12610 catalog_manager.cc:2200] created HMS catalog entry for table [id=53a003cadc7f44339fcad39937ba0ae1]
I20260812 01:50:39.720683 13345 tablet_service.cc:1511] Processing CreateTablet for tablet 6663207a3bed43c1a34366d912e789a6 (DEFAULT_TABLE table=default.table_05e4335fa3134a3495c1c0a5f1cd4313 [id=51c4aa84d04240d3939355629be68e6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:39.719837 13011 tablet_service.cc:1511] Processing CreateTablet for tablet 6663207a3bed43c1a34366d912e789a6 (DEFAULT_TABLE table=default.table_05e4335fa3134a3495c1c0a5f1cd4313 [id=51c4aa84d04240d3939355629be68e6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:39.723580 13179 tablet_service.cc:1511] Processing CreateTablet for tablet 6663207a3bed43c1a34366d912e789a6 (DEFAULT_TABLE table=default.table_05e4335fa3134a3495c1c0a5f1cd4313 [id=51c4aa84d04240d3939355629be68e6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:39.724344 13345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6663207a3bed43c1a34366d912e789a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:39.724745 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6663207a3bed43c1a34366d912e789a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:39.725337 13179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6663207a3bed43c1a34366d912e789a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:39.733841 12610 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_4827643389f34e8b941a8b303a91aedf" } new_table_name: "default.Table_a9ac4ab0283e4af38523d6ba191bf686" modify_external_catalogs: true
I20260812 01:50:39.740217 13178 tablet_service.cc:1511] Processing CreateTablet for tablet 9ba519d3736845c1b752e83f9d2cf50b (DEFAULT_TABLE table=default.table_4827643389f34e8b941a8b303a91aedf [id=53a003cadc7f44339fcad39937ba0ae1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:39.740680 13343 tablet_service.cc:1511] Processing CreateTablet for tablet 9ba519d3736845c1b752e83f9d2cf50b (DEFAULT_TABLE table=default.table_4827643389f34e8b941a8b303a91aedf [id=53a003cadc7f44339fcad39937ba0ae1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:39.740878 13178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ba519d3736845c1b752e83f9d2cf50b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:39.740810 13010 tablet_service.cc:1511] Processing CreateTablet for tablet 9ba519d3736845c1b752e83f9d2cf50b (DEFAULT_TABLE table=default.table_4827643389f34e8b941a8b303a91aedf [id=53a003cadc7f44339fcad39937ba0ae1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:39.741312 13343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ba519d3736845c1b752e83f9d2cf50b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:39.741691 13010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ba519d3736845c1b752e83f9d2cf50b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:39.757726 13505 tablet_bootstrap.cc:492] T 9ba519d3736845c1b752e83f9d2cf50b P 0ced0a6dbcf2486183c801a3a84594d0: Bootstrap starting.
I20260812 01:50:39.767581 13504 tablet_bootstrap.cc:492] T 6663207a3bed43c1a34366d912e789a6 P e0adecc3c8034b71923a3a23c38549a9: Bootstrap starting.
I20260812 01:50:39.769842 13505 tablet_bootstrap.cc:654] T 9ba519d3736845c1b752e83f9d2cf50b P 0ced0a6dbcf2486183c801a3a84594d0: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:39.774730 13504 tablet_bootstrap.cc:654] T 6663207a3bed43c1a34366d912e789a6 P e0adecc3c8034b71923a3a23c38549a9: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:39.776341 13504 log.cc:826] T 6663207a3bed43c1a34366d912e789a6 P e0adecc3c8034b71923a3a23c38549a9: Log is configured to *not* fsync() on all Append() calls
I20260812 01:50:39.777441 13505 log.cc:826] T 9ba519d3736845c1b752e83f9d2cf50b P 0ced0a6dbcf2486183c801a3a84594d0: Log is configured to *not* fsync() on all Append() calls
I20260812 01:50:39.778630 13506 tablet_bootstrap.cc:492] T 9ba519d3736845c1b752e83f9d2cf50b P 3fa1f2b1b9b548df97a1878bfde765b5: Bootstrap starting.
I20260812 01:50:39.782836 13506 tablet_bootstrap.cc:654] T 9ba519d3736845c1b752e83f9d2cf50b P 3fa1f2b1b9b548df97a1878bfde765b5: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:39.784395 13506 log.cc:826] T 9ba519d3736845c1b752e83f9d2cf50b P 3fa1f2b1b9b548df97a1878bfde765b5: Log is configured to *not* fsync() on all Append() calls
I20260812 01:50:39.788679 13505 tablet_bootstrap.cc:492] T 9ba519d3736845c1b752e83f9d2cf50b P 0ced0a6dbcf2486183c801a3a84594d0: No bootstrap required, opened a new log
I20260812 01:50:39.789041 13505 ts_tablet_manager.cc:1403] T 9ba519d3736845c1b752e83f9d2cf50b P 0ced0a6dbcf2486183c801a3a84594d0: Time spent bootstrapping tablet: real 0.032s user 0.008s sys 0.002s
I20260812 01:50:39.793740 13504 tablet_bootstrap.cc:492] T 6663207a3bed43c1a34366d912e789a6 P e0adecc3c8034b71923a3a23c38549a9: No bootstrap required, opened a new log
I20260812 01:50:39.794108 13504 ts_tablet_manager.cc:1403] T 6663207a3bed43c1a34366d912e789a6 P e0adecc3c8034b71923a3a23c38549a9: Time spent bootstrapping tablet: real 0.027s user 0.008s sys 0.002s
I20260812 01:50:39.805332 13505 raft_consensus.cc:359] T 9ba519d3736845c1b752e83f9d2cf50b P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:39.805856 13505 raft_consensus.cc:385] T 9ba519d3736845c1b752e83f9d2cf50b P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:39.805995 13505 raft_consensus.cc:740] T 9ba519d3736845c1b752e83f9d2cf50b P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ced0a6dbcf2486183c801a3a84594d0, State: Initialized, Role: FOLLOWER
I20260812 01:50:39.807766 13504 raft_consensus.cc:359] T 6663207a3bed43c1a34366d912e789a6 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } }
I20260812 01:50:39.808243 13504 raft_consensus.cc:385] T 6663207a3bed43c1a34366d912e789a6 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:39.808375 13504 raft_consensus.cc:740] T 6663207a3bed43c1a34366d912e789a6 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0adecc3c8034b71923a3a23c38549a9, State: Initialized, Role: FOLLOWER
I20260812 01:50:39.809619 13505 consensus_queue.cc:260] T 9ba519d3736845c1b752e83f9d2cf50b P 0ced0a6dbcf2486183c801a3a84594d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:39.810210 13504 consensus_queue.cc:260] T 6663207a3bed43c1a34366d912e789a6 P e0adecc3c8034b71923a3a23c38549a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } }
I20260812 01:50:39.811988 13505 ts_tablet_manager.cc:1434] T 9ba519d3736845c1b752e83f9d2cf50b P 0ced0a6dbcf2486183c801a3a84594d0: Time spent starting tablet: real 0.023s user 0.009s sys 0.001s
I20260812 01:50:39.812492 13505 tablet_bootstrap.cc:492] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0: Bootstrap starting.
I20260812 01:50:39.814913 13505 tablet_bootstrap.cc:654] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:39.819223 13506 tablet_bootstrap.cc:492] T 9ba519d3736845c1b752e83f9d2cf50b P 3fa1f2b1b9b548df97a1878bfde765b5: No bootstrap required, opened a new log
I20260812 01:50:39.819612 13506 ts_tablet_manager.cc:1403] T 9ba519d3736845c1b752e83f9d2cf50b P 3fa1f2b1b9b548df97a1878bfde765b5: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.023s
I20260812 01:50:39.822944 13505 tablet_bootstrap.cc:492] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0: No bootstrap required, opened a new log
I20260812 01:50:39.823104 13505 ts_tablet_manager.cc:1403] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260812 01:50:39.824050 13505 raft_consensus.cc:359] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } }
I20260812 01:50:39.826244 13505 raft_consensus.cc:385] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:39.826367 13505 raft_consensus.cc:740] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ced0a6dbcf2486183c801a3a84594d0, State: Initialized, Role: FOLLOWER
I20260812 01:50:39.826642 13505 consensus_queue.cc:260] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } }
I20260812 01:50:39.827225 13505 ts_tablet_manager.cc:1434] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260812 01:50:39.831549 13506 raft_consensus.cc:359] T 9ba519d3736845c1b752e83f9d2cf50b P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:39.832165 13506 raft_consensus.cc:385] T 9ba519d3736845c1b752e83f9d2cf50b P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:39.832295 13506 raft_consensus.cc:740] T 9ba519d3736845c1b752e83f9d2cf50b P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa1f2b1b9b548df97a1878bfde765b5, State: Initialized, Role: FOLLOWER
I20260812 01:50:39.833242 13506 consensus_queue.cc:260] T 9ba519d3736845c1b752e83f9d2cf50b P 3fa1f2b1b9b548df97a1878bfde765b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:39.835412 13504 ts_tablet_manager.cc:1434] T 6663207a3bed43c1a34366d912e789a6 P e0adecc3c8034b71923a3a23c38549a9: Time spent starting tablet: real 0.041s user 0.008s sys 0.014s
I20260812 01:50:39.835717 13254 heartbeater.cc:499] Master 127.11.243.62:40769 was elected leader, sending a full tablet report...
I20260812 01:50:39.838040 13504 tablet_bootstrap.cc:492] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9: Bootstrap starting.
I20260812 01:50:39.839944 13504 tablet_bootstrap.cc:654] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:39.845778 13506 ts_tablet_manager.cc:1434] T 9ba519d3736845c1b752e83f9d2cf50b P 3fa1f2b1b9b548df97a1878bfde765b5: Time spent starting tablet: real 0.026s user 0.009s sys 0.007s
I20260812 01:50:39.848332 13504 tablet_bootstrap.cc:492] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9: No bootstrap required, opened a new log
I20260812 01:50:39.848523 13504 ts_tablet_manager.cc:1403] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.008s
I20260812 01:50:39.849647 13504 raft_consensus.cc:359] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:39.849891 13504 raft_consensus.cc:385] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:39.850003 13504 raft_consensus.cc:740] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0adecc3c8034b71923a3a23c38549a9, State: Initialized, Role: FOLLOWER
I20260812 01:50:39.850353 13504 consensus_queue.cc:260] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:39.850941 13504 ts_tablet_manager.cc:1434] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 01:50:39.855811 13506 tablet_bootstrap.cc:492] T 6663207a3bed43c1a34366d912e789a6 P 3fa1f2b1b9b548df97a1878bfde765b5: Bootstrap starting.
I20260812 01:50:39.857811 13506 tablet_bootstrap.cc:654] T 6663207a3bed43c1a34366d912e789a6 P 3fa1f2b1b9b548df97a1878bfde765b5: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:39.860519 13506 tablet_bootstrap.cc:492] T 6663207a3bed43c1a34366d912e789a6 P 3fa1f2b1b9b548df97a1878bfde765b5: No bootstrap required, opened a new log
I20260812 01:50:39.860800 13506 ts_tablet_manager.cc:1403] T 6663207a3bed43c1a34366d912e789a6 P 3fa1f2b1b9b548df97a1878bfde765b5: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 01:50:39.861824 13506 raft_consensus.cc:359] T 6663207a3bed43c1a34366d912e789a6 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } }
I20260812 01:50:39.862025 13506 raft_consensus.cc:385] T 6663207a3bed43c1a34366d912e789a6 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:39.862112 13506 raft_consensus.cc:740] T 6663207a3bed43c1a34366d912e789a6 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa1f2b1b9b548df97a1878bfde765b5, State: Initialized, Role: FOLLOWER
I20260812 01:50:39.862464 13506 consensus_queue.cc:260] T 6663207a3bed43c1a34366d912e789a6 P 3fa1f2b1b9b548df97a1878bfde765b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } }
I20260812 01:50:39.864913 13506 ts_tablet_manager.cc:1434] T 6663207a3bed43c1a34366d912e789a6 P 3fa1f2b1b9b548df97a1878bfde765b5: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
W20260812 01:50:39.868781 13096 tablet.cc:2406] T 6663207a3bed43c1a34366d912e789a6 P 3fa1f2b1b9b548df97a1878bfde765b5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:50:39.877424 13514 raft_consensus.cc:493] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:39.877743 13514 raft_consensus.cc:515] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:39.880189 13514 leader_election.cc:290] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765), 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
W20260812 01:50:39.884507 13424 tablet.cc:2406] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:50:39.892392 13034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba519d3736845c1b752e83f9d2cf50b" candidate_uuid: "e0adecc3c8034b71923a3a23c38549a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" is_pre_election: true
I20260812 01:50:39.893042 13034 raft_consensus.cc:2468] T 9ba519d3736845c1b752e83f9d2cf50b P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0adecc3c8034b71923a3a23c38549a9 in term 0.
I20260812 01:50:39.894317 13127 leader_election.cc:304] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa1f2b1b9b548df97a1878bfde765b5, e0adecc3c8034b71923a3a23c38549a9; no voters:
I20260812 01:50:39.894934 13514 raft_consensus.cc:2804] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:50:39.895102 13514 raft_consensus.cc:493] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:50:39.895220 13514 raft_consensus.cc:3060] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:39.899190 13514 raft_consensus.cc:515] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:39.900691 13034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba519d3736845c1b752e83f9d2cf50b" candidate_uuid: "e0adecc3c8034b71923a3a23c38549a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa1f2b1b9b548df97a1878bfde765b5"
I20260812 01:50:39.900941 13034 raft_consensus.cc:3060] T 9ba519d3736845c1b752e83f9d2cf50b P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:39.901221 13370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba519d3736845c1b752e83f9d2cf50b" candidate_uuid: "e0adecc3c8034b71923a3a23c38549a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ced0a6dbcf2486183c801a3a84594d0" is_pre_election: true
I20260812 01:50:39.901835 13370 raft_consensus.cc:2468] T 9ba519d3736845c1b752e83f9d2cf50b P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0adecc3c8034b71923a3a23c38549a9 in term 0.
I20260812 01:50:39.904531 13034 raft_consensus.cc:2468] T 9ba519d3736845c1b752e83f9d2cf50b P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0adecc3c8034b71923a3a23c38549a9 in term 1.
I20260812 01:50:39.905258 13127 leader_election.cc:304] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa1f2b1b9b548df97a1878bfde765b5, e0adecc3c8034b71923a3a23c38549a9; no voters:
I20260812 01:50:39.905752 13370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ba519d3736845c1b752e83f9d2cf50b" candidate_uuid: "e0adecc3c8034b71923a3a23c38549a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ced0a6dbcf2486183c801a3a84594d0"
I20260812 01:50:39.905970 13370 raft_consensus.cc:3060] T 9ba519d3736845c1b752e83f9d2cf50b P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:39.909294 13514 leader_election.cc:290] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9 [CANDIDATE]: Term 1 election: Requested vote from peers 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765), 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:50:39.909332 13370 raft_consensus.cc:2468] T 9ba519d3736845c1b752e83f9d2cf50b P 0ced0a6dbcf2486183c801a3a84594d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0adecc3c8034b71923a3a23c38549a9 in term 1.
I20260812 01:50:39.909617 13514 raft_consensus.cc:2804] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:50:39.909808 13514 raft_consensus.cc:697] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9 [term 1 LEADER]: Becoming Leader. State: Replica: e0adecc3c8034b71923a3a23c38549a9, State: Running, Role: LEADER
I20260812 01:50:39.910061 12236 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskOMow7D/build/asan/bin/kudu
/tmp/dist-test-taskOMow7D/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.243.60:33215
--webserver_interface=127.11.243.60
--webserver_port=45607
--builtin_ntp_servers=127.11.243.20:42563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--hive_metastore_uris=thrift://127.0.0.1:35039
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260812 01:50:39.910426 13514 consensus_queue.cc:237] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
01:50:40.025 [HMS - ERROR - pool-6-thread-3] (RetryingHMSHandler.java:201) AlreadyExistsException(message:Table hive.default.table_6896943d0549474caa2928d9fd085a3a already exists)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:1839)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:1786)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_with_environment_context(HiveMetaStore.java:2035)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108)
at jdk.proxy2/jdk.proxy2.$Proxy27.create_table_with_environment_context(Unknown Source)
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:14800)
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:14784)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:104)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:840)
W20260812 01:50:40.039120 12614 catalog_manager.cc:2196] Already present: failed to create HMS catalog entry for table [id=ef8defc73a1e4e00a227d3d709fd0847]: failed to create Hive MetaStore table: TException - service has thrown: AlreadyExistsException(message=Table hive.default.table_6896943d0549474caa2928d9fd085a3a already exists)
I20260812 01:50:40.044201 13421 heartbeater.cc:499] Master 127.11.243.62:40769 was elected leader, sending a full tablet report...
I20260812 01:50:40.047444 13092 heartbeater.cc:499] Master 127.11.243.62:40769 was elected leader, sending a full tablet report...
W20260812 01:50:40.049256 13261 tablet.cc:2406] T 6663207a3bed43c1a34366d912e789a6 P e0adecc3c8034b71923a3a23c38549a9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 01:50:40.051111 12614 catalog_manager.cc:5719] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2). New cstate: current_term: 1 leader_uuid: "e0adecc3c8034b71923a3a23c38549a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } health_report { overall_health: UNKNOWN } } }
I20260812 01:50:40.069007 12614 master_service.cc:960] ReplaceTablet: received request to replace tablet 9ba519d3736845c1b752e83f9d2cf50b from {username='slave'} at 127.0.0.1:46888
I20260812 01:50:40.079288 13513 raft_consensus.cc:493] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:40.079509 13513 raft_consensus.cc:515] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } }
I20260812 01:50:40.079727 12614 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066: Sending DeleteTablet for 3 replicas of tablet 9ba519d3736845c1b752e83f9d2cf50b
I20260812 01:50:40.081511 13010 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ba519d3736845c1b752e83f9d2cf50b with delete_type TABLET_DATA_DELETED (replaced by tablet 6efaedf1b58840de991c63a645e0dc39) from {username='slave'} at 127.0.0.1:38382
I20260812 01:50:40.081909 13513 leader_election.cc:290] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765), e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853)
I20260812 01:50:40.084465 12607 catalog_manager.cc:2200] created HMS catalog entry for table [id=5f027eb5cb18441a8b12f882655a1897]
I20260812 01:50:40.096123 12607 master_service.cc:960] ReplaceTablet: received request to replace tablet 9ba519d3736845c1b752e83f9d2cf50b from {username='slave'} at 127.0.0.1:46888
I20260812 01:50:40.096513 13526 tablet_replica.cc:333] T 9ba519d3736845c1b752e83f9d2cf50b P 3fa1f2b1b9b548df97a1878bfde765b5: stopping tablet replica
I20260812 01:50:40.097010 12607 master_service.cc:960] ReplaceTablet: received request to replace tablet 9ba519d3736845c1b752e83f9d2cf50b from {username='slave'} at 127.0.0.1:46888
I20260812 01:50:40.096944 13179 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ba519d3736845c1b752e83f9d2cf50b with delete_type TABLET_DATA_DELETED (replaced by tablet 6efaedf1b58840de991c63a645e0dc39) from {username='slave'} at 127.0.0.1:58964
I20260812 01:50:40.097223 13526 raft_consensus.cc:2243] T 9ba519d3736845c1b752e83f9d2cf50b P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:50:40.097489 12607 master_service.cc:960] ReplaceTablet: received request to replace tablet 9ba519d3736845c1b752e83f9d2cf50b from {username='slave'} at 127.0.0.1:46888
I20260812 01:50:40.097769 13526 raft_consensus.cc:2272] T 9ba519d3736845c1b752e83f9d2cf50b P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:50:40.097914 12607 master_service.cc:960] ReplaceTablet: received request to replace tablet 9ba519d3736845c1b752e83f9d2cf50b from {username='slave'} at 127.0.0.1:46888
I20260812 01:50:40.098464 12607 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_1136408fd2f648dcbf9d582bb5764e10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:40.100307 13526 ts_tablet_manager.cc:1916] T 9ba519d3736845c1b752e83f9d2cf50b P 3fa1f2b1b9b548df97a1878bfde765b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:50:40.104584 13345 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ba519d3736845c1b752e83f9d2cf50b with delete_type TABLET_DATA_DELETED (replaced by tablet 6efaedf1b58840de991c63a645e0dc39) from {username='slave'} at 127.0.0.1:55990
I20260812 01:50:40.109416 13526 ts_tablet_manager.cc:1929] T 9ba519d3736845c1b752e83f9d2cf50b P 3fa1f2b1b9b548df97a1878bfde765b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 01:50:40.109583 13526 log.cc:1199] T 9ba519d3736845c1b752e83f9d2cf50b P 3fa1f2b1b9b548df97a1878bfde765b5: Deleting WAL directory at /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-0/wal/wals/9ba519d3736845c1b752e83f9d2cf50b
I20260812 01:50:40.110201 13526 ts_tablet_manager.cc:1950] T 9ba519d3736845c1b752e83f9d2cf50b P 3fa1f2b1b9b548df97a1878bfde765b5: Deleting consensus metadata
I20260812 01:50:40.112607 12601 catalog_manager.cc:5050] TS 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765): tablet 9ba519d3736845c1b752e83f9d2cf50b (table default.table_4827643389f34e8b941a8b303a91aedf [id=53a003cadc7f44339fcad39937ba0ae1]) successfully deleted
I20260812 01:50:40.116619 13034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6663207a3bed43c1a34366d912e789a6" candidate_uuid: "0ced0a6dbcf2486183c801a3a84594d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" is_pre_election: true
I20260812 01:50:40.116902 13034 raft_consensus.cc:2468] T 6663207a3bed43c1a34366d912e789a6 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ced0a6dbcf2486183c801a3a84594d0 in term 0.
I20260812 01:50:40.117061 13202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6663207a3bed43c1a34366d912e789a6" candidate_uuid: "0ced0a6dbcf2486183c801a3a84594d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0adecc3c8034b71923a3a23c38549a9" is_pre_election: true
I20260812 01:50:40.117573 13202 raft_consensus.cc:2468] T 6663207a3bed43c1a34366d912e789a6 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ced0a6dbcf2486183c801a3a84594d0 in term 0.
I20260812 01:50:40.117558 13290 leader_election.cc:304] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ced0a6dbcf2486183c801a3a84594d0, 3fa1f2b1b9b548df97a1878bfde765b5; no voters:
I20260812 01:50:40.118103 13513 raft_consensus.cc:2804] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:50:40.118274 13513 raft_consensus.cc:493] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:50:40.118393 13513 raft_consensus.cc:3060] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:40.119982 13528 tablet_replica.cc:333] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9: stopping tablet replica
I20260812 01:50:40.120066 13178 tablet_service.cc:1511] Processing CreateTablet for tablet 230f3a15dade4e7e8dffcc9afcbe61bf (DEFAULT_TABLE table=default.table_9e18b143855f48a1ab04f0fbbb4a7130 [id=5f027eb5cb18441a8b12f882655a1897]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.120482 13528 raft_consensus.cc:2243] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:50:40.120532 13178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 230f3a15dade4e7e8dffcc9afcbe61bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.121286 13528 pending_rounds.cc:70] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9: Trying to abort 1 pending ops.
I20260812 01:50:40.121505 13528 pending_rounds.cc:77] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317501705878073344 op_type: NO_OP noop_request { }
I20260812 01:50:40.121730 13528 raft_consensus.cc:2889] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260812 01:50:40.121887 13528 raft_consensus.cc:2272] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:50:40.121948 13010 tablet_service.cc:1511] Processing CreateTablet for tablet 230f3a15dade4e7e8dffcc9afcbe61bf (DEFAULT_TABLE table=default.table_9e18b143855f48a1ab04f0fbbb4a7130 [id=5f027eb5cb18441a8b12f882655a1897]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.122381 13010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 230f3a15dade4e7e8dffcc9afcbe61bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.096123 12614 catalog_manager.cc:6807] ReplaceTablet: tablet 9ba519d3736845c1b752e83f9d2cf50b deleted and replaced by tablet 6efaedf1b58840de991c63a645e0dc39
I20260812 01:50:40.125509 13011 tablet_service.cc:1511] Processing CreateTablet for tablet 6efaedf1b58840de991c63a645e0dc39 (DEFAULT_TABLE table=default.table_4827643389f34e8b941a8b303a91aedf [id=53a003cadc7f44339fcad39937ba0ae1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.125896 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6efaedf1b58840de991c63a645e0dc39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.125880 12614 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_928e3ae44e3245f3a62ae1724ccd100a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:40.126430 13342 tablet_service.cc:1511] Processing CreateTablet for tablet 6efaedf1b58840de991c63a645e0dc39 (DEFAULT_TABLE table=default.table_4827643389f34e8b941a8b303a91aedf [id=53a003cadc7f44339fcad39937ba0ae1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.127172 13342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6efaedf1b58840de991c63a645e0dc39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.129712 13529 tablet_replica.cc:333] T 9ba519d3736845c1b752e83f9d2cf50b P 0ced0a6dbcf2486183c801a3a84594d0: stopping tablet replica
I20260812 01:50:40.129770 13343 tablet_service.cc:1511] Processing CreateTablet for tablet 230f3a15dade4e7e8dffcc9afcbe61bf (DEFAULT_TABLE table=default.table_9e18b143855f48a1ab04f0fbbb4a7130 [id=5f027eb5cb18441a8b12f882655a1897]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.130306 13343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 230f3a15dade4e7e8dffcc9afcbe61bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.133579 13179 tablet_service.cc:1511] Processing CreateTablet for tablet 6efaedf1b58840de991c63a645e0dc39 (DEFAULT_TABLE table=default.table_4827643389f34e8b941a8b303a91aedf [id=53a003cadc7f44339fcad39937ba0ae1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.134264 13179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6efaedf1b58840de991c63a645e0dc39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.135891 13504 tablet_bootstrap.cc:492] T 230f3a15dade4e7e8dffcc9afcbe61bf P e0adecc3c8034b71923a3a23c38549a9: Bootstrap starting.
I20260812 01:50:40.137791 13504 tablet_bootstrap.cc:654] T 230f3a15dade4e7e8dffcc9afcbe61bf P e0adecc3c8034b71923a3a23c38549a9: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:40.141021 13528 ts_tablet_manager.cc:1916] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:50:40.145572 13506 tablet_bootstrap.cc:492] T 230f3a15dade4e7e8dffcc9afcbe61bf P 3fa1f2b1b9b548df97a1878bfde765b5: Bootstrap starting.
I20260812 01:50:40.146713 13528 ts_tablet_manager.cc:1929] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 01:50:40.146938 13528 log.cc:1199] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9: Deleting WAL directory at /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-1/wal/wals/9ba519d3736845c1b752e83f9d2cf50b
I20260812 01:50:40.147501 13528 ts_tablet_manager.cc:1950] T 9ba519d3736845c1b752e83f9d2cf50b P e0adecc3c8034b71923a3a23c38549a9: Deleting consensus metadata
I20260812 01:50:40.147543 13506 tablet_bootstrap.cc:654] T 230f3a15dade4e7e8dffcc9afcbe61bf P 3fa1f2b1b9b548df97a1878bfde765b5: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:40.150385 12599 catalog_manager.cc:5050] TS e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853): tablet 9ba519d3736845c1b752e83f9d2cf50b (table default.table_4827643389f34e8b941a8b303a91aedf [id=53a003cadc7f44339fcad39937ba0ae1]) successfully deleted
I20260812 01:50:40.151248 13529 raft_consensus.cc:2243] T 9ba519d3736845c1b752e83f9d2cf50b P 0ced0a6dbcf2486183c801a3a84594d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:50:40.154812 13513 raft_consensus.cc:515] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } }
I20260812 01:50:40.156186 13034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6663207a3bed43c1a34366d912e789a6" candidate_uuid: "0ced0a6dbcf2486183c801a3a84594d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa1f2b1b9b548df97a1878bfde765b5"
I20260812 01:50:40.156435 13034 raft_consensus.cc:3060] T 6663207a3bed43c1a34366d912e789a6 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:40.158627 13504 tablet_bootstrap.cc:492] T 230f3a15dade4e7e8dffcc9afcbe61bf P e0adecc3c8034b71923a3a23c38549a9: No bootstrap required, opened a new log
I20260812 01:50:40.158843 13504 ts_tablet_manager.cc:1403] T 230f3a15dade4e7e8dffcc9afcbe61bf P e0adecc3c8034b71923a3a23c38549a9: Time spent bootstrapping tablet: real 0.023s user 0.011s sys 0.004s
I20260812 01:50:40.159603 13034 raft_consensus.cc:2468] T 6663207a3bed43c1a34366d912e789a6 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ced0a6dbcf2486183c801a3a84594d0 in term 1.
I20260812 01:50:40.159719 13504 raft_consensus.cc:359] T 230f3a15dade4e7e8dffcc9afcbe61bf P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.160041 13504 raft_consensus.cc:385] T 230f3a15dade4e7e8dffcc9afcbe61bf P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:40.160194 13504 raft_consensus.cc:740] T 230f3a15dade4e7e8dffcc9afcbe61bf P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0adecc3c8034b71923a3a23c38549a9, State: Initialized, Role: FOLLOWER
I20260812 01:50:40.160373 13290 leader_election.cc:304] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ced0a6dbcf2486183c801a3a84594d0, 3fa1f2b1b9b548df97a1878bfde765b5; no voters:
I20260812 01:50:40.160533 13504 consensus_queue.cc:260] T 230f3a15dade4e7e8dffcc9afcbe61bf P e0adecc3c8034b71923a3a23c38549a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.161206 13504 ts_tablet_manager.cc:1434] T 230f3a15dade4e7e8dffcc9afcbe61bf P e0adecc3c8034b71923a3a23c38549a9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260812 01:50:40.162706 13505 tablet_bootstrap.cc:492] T 6efaedf1b58840de991c63a645e0dc39 P 0ced0a6dbcf2486183c801a3a84594d0: Bootstrap starting.
I20260812 01:50:40.163616 13504 tablet_bootstrap.cc:492] T 6efaedf1b58840de991c63a645e0dc39 P e0adecc3c8034b71923a3a23c38549a9: Bootstrap starting.
I20260812 01:50:40.164824 13505 tablet_bootstrap.cc:654] T 6efaedf1b58840de991c63a645e0dc39 P 0ced0a6dbcf2486183c801a3a84594d0: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:40.165444 13504 tablet_bootstrap.cc:654] T 6efaedf1b58840de991c63a645e0dc39 P e0adecc3c8034b71923a3a23c38549a9: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:40.165524 13513 leader_election.cc:290] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0 [CANDIDATE]: Term 1 election: Requested vote from peers 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765), e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853)
I20260812 01:50:40.166092 13529 raft_consensus.cc:2272] T 9ba519d3736845c1b752e83f9d2cf50b P 0ced0a6dbcf2486183c801a3a84594d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:50:40.167735 13202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6663207a3bed43c1a34366d912e789a6" candidate_uuid: "0ced0a6dbcf2486183c801a3a84594d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0adecc3c8034b71923a3a23c38549a9"
I20260812 01:50:40.167999 13202 raft_consensus.cc:3060] T 6663207a3bed43c1a34366d912e789a6 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:40.176764 13513 raft_consensus.cc:2804] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:50:40.177531 13513 raft_consensus.cc:697] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0 [term 1 LEADER]: Becoming Leader. State: Replica: 0ced0a6dbcf2486183c801a3a84594d0, State: Running, Role: LEADER
I20260812 01:50:40.177850 13202 raft_consensus.cc:2468] T 6663207a3bed43c1a34366d912e789a6 P e0adecc3c8034b71923a3a23c38549a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ced0a6dbcf2486183c801a3a84594d0 in term 1.
I20260812 01:50:40.178496 13506 tablet_bootstrap.cc:492] T 230f3a15dade4e7e8dffcc9afcbe61bf P 3fa1f2b1b9b548df97a1878bfde765b5: No bootstrap required, opened a new log
I20260812 01:50:40.178737 13506 ts_tablet_manager.cc:1403] T 230f3a15dade4e7e8dffcc9afcbe61bf P 3fa1f2b1b9b548df97a1878bfde765b5: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.000s
I20260812 01:50:40.179687 13506 raft_consensus.cc:359] T 230f3a15dade4e7e8dffcc9afcbe61bf P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.179922 13506 raft_consensus.cc:385] T 230f3a15dade4e7e8dffcc9afcbe61bf P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:40.180022 13506 raft_consensus.cc:740] T 230f3a15dade4e7e8dffcc9afcbe61bf P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa1f2b1b9b548df97a1878bfde765b5, State: Initialized, Role: FOLLOWER
I20260812 01:50:40.181996 13513 consensus_queue.cc:237] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } }
I20260812 01:50:40.184844 13506 consensus_queue.cc:260] T 230f3a15dade4e7e8dffcc9afcbe61bf P 3fa1f2b1b9b548df97a1878bfde765b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.190209 13506 ts_tablet_manager.cc:1434] T 230f3a15dade4e7e8dffcc9afcbe61bf P 3fa1f2b1b9b548df97a1878bfde765b5: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260812 01:50:40.191745 13506 tablet_bootstrap.cc:492] T 6efaedf1b58840de991c63a645e0dc39 P 3fa1f2b1b9b548df97a1878bfde765b5: Bootstrap starting.
I20260812 01:50:40.194557 13505 tablet_bootstrap.cc:492] T 6efaedf1b58840de991c63a645e0dc39 P 0ced0a6dbcf2486183c801a3a84594d0: No bootstrap required, opened a new log
I20260812 01:50:40.194784 13505 ts_tablet_manager.cc:1403] T 6efaedf1b58840de991c63a645e0dc39 P 0ced0a6dbcf2486183c801a3a84594d0: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.004s
I20260812 01:50:40.195642 13505 raft_consensus.cc:359] T 6efaedf1b58840de991c63a645e0dc39 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.195887 13505 raft_consensus.cc:385] T 6efaedf1b58840de991c63a645e0dc39 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:40.195990 13505 raft_consensus.cc:740] T 6efaedf1b58840de991c63a645e0dc39 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ced0a6dbcf2486183c801a3a84594d0, State: Initialized, Role: FOLLOWER
I20260812 01:50:40.197016 13506 tablet_bootstrap.cc:654] T 6efaedf1b58840de991c63a645e0dc39 P 3fa1f2b1b9b548df97a1878bfde765b5: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:40.198246 13505 consensus_queue.cc:260] T 6efaedf1b58840de991c63a645e0dc39 P 0ced0a6dbcf2486183c801a3a84594d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.198833 13505 ts_tablet_manager.cc:1434] T 6efaedf1b58840de991c63a645e0dc39 P 0ced0a6dbcf2486183c801a3a84594d0: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260812 01:50:40.200441 13505 tablet_bootstrap.cc:492] T 230f3a15dade4e7e8dffcc9afcbe61bf P 0ced0a6dbcf2486183c801a3a84594d0: Bootstrap starting.
I20260812 01:50:40.203822 13529 ts_tablet_manager.cc:1916] T 9ba519d3736845c1b752e83f9d2cf50b P 0ced0a6dbcf2486183c801a3a84594d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:50:40.211215 13505 tablet_bootstrap.cc:654] T 230f3a15dade4e7e8dffcc9afcbe61bf P 0ced0a6dbcf2486183c801a3a84594d0: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:40.216212 13504 tablet_bootstrap.cc:492] T 6efaedf1b58840de991c63a645e0dc39 P e0adecc3c8034b71923a3a23c38549a9: No bootstrap required, opened a new log
I20260812 01:50:40.216403 13504 ts_tablet_manager.cc:1403] T 6efaedf1b58840de991c63a645e0dc39 P e0adecc3c8034b71923a3a23c38549a9: Time spent bootstrapping tablet: real 0.053s user 0.023s sys 0.026s
I20260812 01:50:40.217551 13504 raft_consensus.cc:359] T 6efaedf1b58840de991c63a645e0dc39 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.217749 13504 raft_consensus.cc:385] T 6efaedf1b58840de991c63a645e0dc39 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:40.217852 13504 raft_consensus.cc:740] T 6efaedf1b58840de991c63a645e0dc39 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0adecc3c8034b71923a3a23c38549a9, State: Initialized, Role: FOLLOWER
I20260812 01:50:40.218106 13504 consensus_queue.cc:260] T 6efaedf1b58840de991c63a645e0dc39 P e0adecc3c8034b71923a3a23c38549a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.218696 13504 ts_tablet_manager.cc:1434] T 6efaedf1b58840de991c63a645e0dc39 P e0adecc3c8034b71923a3a23c38549a9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260812 01:50:40.221642 13505 tablet_bootstrap.cc:492] T 230f3a15dade4e7e8dffcc9afcbe61bf P 0ced0a6dbcf2486183c801a3a84594d0: No bootstrap required, opened a new log
I20260812 01:50:40.221838 13505 ts_tablet_manager.cc:1403] T 230f3a15dade4e7e8dffcc9afcbe61bf P 0ced0a6dbcf2486183c801a3a84594d0: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.000s
I20260812 01:50:40.223842 13506 tablet_bootstrap.cc:492] T 6efaedf1b58840de991c63a645e0dc39 P 3fa1f2b1b9b548df97a1878bfde765b5: No bootstrap required, opened a new log
I20260812 01:50:40.224025 13506 ts_tablet_manager.cc:1403] T 6efaedf1b58840de991c63a645e0dc39 P 3fa1f2b1b9b548df97a1878bfde765b5: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.000s
I20260812 01:50:40.225504 13506 raft_consensus.cc:359] T 6efaedf1b58840de991c63a645e0dc39 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.225749 13506 raft_consensus.cc:385] T 6efaedf1b58840de991c63a645e0dc39 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:40.225862 13506 raft_consensus.cc:740] T 6efaedf1b58840de991c63a645e0dc39 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa1f2b1b9b548df97a1878bfde765b5, State: Initialized, Role: FOLLOWER
I20260812 01:50:40.226174 13506 consensus_queue.cc:260] T 6efaedf1b58840de991c63a645e0dc39 P 3fa1f2b1b9b548df97a1878bfde765b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.228080 13506 ts_tablet_manager.cc:1434] T 6efaedf1b58840de991c63a645e0dc39 P 3fa1f2b1b9b548df97a1878bfde765b5: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260812 01:50:40.229724 13505 raft_consensus.cc:359] T 230f3a15dade4e7e8dffcc9afcbe61bf P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.229974 13505 raft_consensus.cc:385] T 230f3a15dade4e7e8dffcc9afcbe61bf P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:40.230106 13505 raft_consensus.cc:740] T 230f3a15dade4e7e8dffcc9afcbe61bf P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ced0a6dbcf2486183c801a3a84594d0, State: Initialized, Role: FOLLOWER
I20260812 01:50:40.233486 13529 ts_tablet_manager.cc:1929] T 9ba519d3736845c1b752e83f9d2cf50b P 0ced0a6dbcf2486183c801a3a84594d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 01:50:40.233711 13529 log.cc:1199] T 9ba519d3736845c1b752e83f9d2cf50b P 0ced0a6dbcf2486183c801a3a84594d0: Deleting WAL directory at /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-2/wal/wals/9ba519d3736845c1b752e83f9d2cf50b
I20260812 01:50:40.234258 13529 ts_tablet_manager.cc:1950] T 9ba519d3736845c1b752e83f9d2cf50b P 0ced0a6dbcf2486183c801a3a84594d0: Deleting consensus metadata
I20260812 01:50:40.234441 13505 consensus_queue.cc:260] T 230f3a15dade4e7e8dffcc9afcbe61bf P 0ced0a6dbcf2486183c801a3a84594d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.236275 12599 catalog_manager.cc:5050] TS 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197): tablet 9ba519d3736845c1b752e83f9d2cf50b (table default.table_4827643389f34e8b941a8b303a91aedf [id=53a003cadc7f44339fcad39937ba0ae1]) successfully deleted
I20260812 01:50:40.241761 13505 ts_tablet_manager.cc:1434] T 230f3a15dade4e7e8dffcc9afcbe61bf P 0ced0a6dbcf2486183c801a3a84594d0: Time spent starting tablet: real 0.020s user 0.003s sys 0.000s
I20260812 01:50:40.247237 12613 catalog_manager.cc:2200] created HMS catalog entry for table [id=f4140461eb024e01ab55c03106c63a3c]
I20260812 01:50:40.258034 12613 catalog_manager.cc:5719] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3). New cstate: current_term: 1 leader_uuid: "0ced0a6dbcf2486183c801a3a84594d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260812 01:50:40.284034 13179 tablet_service.cc:1511] Processing CreateTablet for tablet 0dce52a81cf34fdb8f7798a28ec7bb33 (DEFAULT_TABLE table=default.table_f04e78d3952146c88cb523c551527e23 [id=f4140461eb024e01ab55c03106c63a3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.284601 13179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dce52a81cf34fdb8f7798a28ec7bb33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.285125 13343 tablet_service.cc:1511] Processing CreateTablet for tablet 0dce52a81cf34fdb8f7798a28ec7bb33 (DEFAULT_TABLE table=default.table_f04e78d3952146c88cb523c551527e23 [id=f4140461eb024e01ab55c03106c63a3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.285605 13343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dce52a81cf34fdb8f7798a28ec7bb33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.288527 12613 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_65f203f5b94f4efb9d107338b6e02963"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:40.294131 13505 tablet_bootstrap.cc:492] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0: Bootstrap starting.
I20260812 01:50:40.294075 13011 tablet_service.cc:1511] Processing CreateTablet for tablet 0dce52a81cf34fdb8f7798a28ec7bb33 (DEFAULT_TABLE table=default.table_f04e78d3952146c88cb523c551527e23 [id=f4140461eb024e01ab55c03106c63a3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.294566 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dce52a81cf34fdb8f7798a28ec7bb33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.296118 13505 tablet_bootstrap.cc:654] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:40.297056 13504 tablet_bootstrap.cc:492] T 0dce52a81cf34fdb8f7798a28ec7bb33 P e0adecc3c8034b71923a3a23c38549a9: Bootstrap starting.
I20260812 01:50:40.298890 13504 tablet_bootstrap.cc:654] T 0dce52a81cf34fdb8f7798a28ec7bb33 P e0adecc3c8034b71923a3a23c38549a9: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:40.302235 13506 tablet_bootstrap.cc:492] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 3fa1f2b1b9b548df97a1878bfde765b5: Bootstrap starting.
I20260812 01:50:40.304136 13506 tablet_bootstrap.cc:654] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 3fa1f2b1b9b548df97a1878bfde765b5: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:40.306586 13505 tablet_bootstrap.cc:492] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0: No bootstrap required, opened a new log
I20260812 01:50:40.306852 13505 ts_tablet_manager.cc:1403] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.001s
I20260812 01:50:40.308018 13505 raft_consensus.cc:359] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.308341 13505 raft_consensus.cc:385] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:40.308439 13505 raft_consensus.cc:740] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ced0a6dbcf2486183c801a3a84594d0, State: Initialized, Role: FOLLOWER
I20260812 01:50:40.308764 13505 consensus_queue.cc:260] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.314095 13505 ts_tablet_manager.cc:1434] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0: Time spent starting tablet: real 0.007s user 0.000s sys 0.003s
I20260812 01:50:40.321913 13506 tablet_bootstrap.cc:492] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 3fa1f2b1b9b548df97a1878bfde765b5: No bootstrap required, opened a new log
I20260812 01:50:40.322166 13506 ts_tablet_manager.cc:1403] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 3fa1f2b1b9b548df97a1878bfde765b5: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.004s
I20260812 01:50:40.323135 13506 raft_consensus.cc:359] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.323401 13506 raft_consensus.cc:385] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:40.323488 13506 raft_consensus.cc:740] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa1f2b1b9b548df97a1878bfde765b5, State: Initialized, Role: FOLLOWER
I20260812 01:50:40.323781 13506 consensus_queue.cc:260] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 3fa1f2b1b9b548df97a1878bfde765b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.325019 13506 ts_tablet_manager.cc:1434] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 3fa1f2b1b9b548df97a1878bfde765b5: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260812 01:50:40.327417 13504 tablet_bootstrap.cc:492] T 0dce52a81cf34fdb8f7798a28ec7bb33 P e0adecc3c8034b71923a3a23c38549a9: No bootstrap required, opened a new log
I20260812 01:50:40.335136 13504 ts_tablet_manager.cc:1403] T 0dce52a81cf34fdb8f7798a28ec7bb33 P e0adecc3c8034b71923a3a23c38549a9: Time spent bootstrapping tablet: real 0.038s user 0.008s sys 0.000s
I20260812 01:50:40.336522 13504 raft_consensus.cc:359] T 0dce52a81cf34fdb8f7798a28ec7bb33 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.337051 13504 raft_consensus.cc:385] T 0dce52a81cf34fdb8f7798a28ec7bb33 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:40.337248 13504 raft_consensus.cc:740] T 0dce52a81cf34fdb8f7798a28ec7bb33 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0adecc3c8034b71923a3a23c38549a9, State: Initialized, Role: FOLLOWER
I20260812 01:50:40.337692 13504 consensus_queue.cc:260] T 0dce52a81cf34fdb8f7798a28ec7bb33 P e0adecc3c8034b71923a3a23c38549a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.343480 13504 ts_tablet_manager.cc:1434] T 0dce52a81cf34fdb8f7798a28ec7bb33 P e0adecc3c8034b71923a3a23c38549a9: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260812 01:50:40.361747 13513 raft_consensus.cc:493] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:40.362068 13513 raft_consensus.cc:515] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.363087 13513 leader_election.cc:290] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765), e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853)
I20260812 01:50:40.364876 13034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dce52a81cf34fdb8f7798a28ec7bb33" candidate_uuid: "0ced0a6dbcf2486183c801a3a84594d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" is_pre_election: true
I20260812 01:50:40.365176 13034 raft_consensus.cc:2468] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ced0a6dbcf2486183c801a3a84594d0 in term 0.
I20260812 01:50:40.365656 13202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dce52a81cf34fdb8f7798a28ec7bb33" candidate_uuid: "0ced0a6dbcf2486183c801a3a84594d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0adecc3c8034b71923a3a23c38549a9" is_pre_election: true
I20260812 01:50:40.365932 13202 raft_consensus.cc:2468] T 0dce52a81cf34fdb8f7798a28ec7bb33 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ced0a6dbcf2486183c801a3a84594d0 in term 0.
I20260812 01:50:40.366809 13286 leader_election.cc:304] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ced0a6dbcf2486183c801a3a84594d0, e0adecc3c8034b71923a3a23c38549a9; no voters:
I20260812 01:50:40.367795 13513 raft_consensus.cc:2804] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:50:40.367911 13513 raft_consensus.cc:493] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:50:40.368017 13513 raft_consensus.cc:3060] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:40.372179 13513 raft_consensus.cc:515] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.373605 13034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dce52a81cf34fdb8f7798a28ec7bb33" candidate_uuid: "0ced0a6dbcf2486183c801a3a84594d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa1f2b1b9b548df97a1878bfde765b5"
I20260812 01:50:40.373850 13034 raft_consensus.cc:3060] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:40.377507 13034 raft_consensus.cc:2468] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ced0a6dbcf2486183c801a3a84594d0 in term 1.
I20260812 01:50:40.378257 13290 leader_election.cc:304] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ced0a6dbcf2486183c801a3a84594d0, 3fa1f2b1b9b548df97a1878bfde765b5; no voters:
I20260812 01:50:40.378641 13533 raft_consensus.cc:2804] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:50:40.379920 13202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dce52a81cf34fdb8f7798a28ec7bb33" candidate_uuid: "0ced0a6dbcf2486183c801a3a84594d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0adecc3c8034b71923a3a23c38549a9"
I20260812 01:50:40.380111 13533 raft_consensus.cc:697] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0 [term 1 LEADER]: Becoming Leader. State: Replica: 0ced0a6dbcf2486183c801a3a84594d0, State: Running, Role: LEADER
I20260812 01:50:40.380199 13202 raft_consensus.cc:3060] T 0dce52a81cf34fdb8f7798a28ec7bb33 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:40.380558 13533 consensus_queue.cc:237] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.383862 13202 raft_consensus.cc:2468] T 0dce52a81cf34fdb8f7798a28ec7bb33 P e0adecc3c8034b71923a3a23c38549a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ced0a6dbcf2486183c801a3a84594d0 in term 1.
I20260812 01:50:40.385532 13513 leader_election.cc:290] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0 [CANDIDATE]: Term 1 election: Requested vote from peers 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765), e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853)
I20260812 01:50:40.411962 12611 catalog_manager.cc:2200] created HMS catalog entry for table [id=38ffa4a422954b5f8a6acb79fbbd95a1]
I20260812 01:50:40.435987 13179 tablet_service.cc:1511] Processing CreateTablet for tablet 0872a7468f0241aa8a2a544a5a272abb (DEFAULT_TABLE table=default.table_fce810b18eef421f8cb8d4fffce6a188 [id=38ffa4a422954b5f8a6acb79fbbd95a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.436653 13179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0872a7468f0241aa8a2a544a5a272abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.441910 13011 tablet_service.cc:1511] Processing CreateTablet for tablet 0872a7468f0241aa8a2a544a5a272abb (DEFAULT_TABLE table=default.table_fce810b18eef421f8cb8d4fffce6a188 [id=38ffa4a422954b5f8a6acb79fbbd95a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.442006 12611 catalog_manager.cc:5719] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3). New cstate: current_term: 1 leader_uuid: "0ced0a6dbcf2486183c801a3a84594d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } health_report { overall_health: HEALTHY } } }
I20260812 01:50:40.442485 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0872a7468f0241aa8a2a544a5a272abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.448684 13343 tablet_service.cc:1511] Processing CreateTablet for tablet 0872a7468f0241aa8a2a544a5a272abb (DEFAULT_TABLE table=default.table_fce810b18eef421f8cb8d4fffce6a188 [id=38ffa4a422954b5f8a6acb79fbbd95a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.449265 13343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0872a7468f0241aa8a2a544a5a272abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.468040 12611 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_9e18b143855f48a1ab04f0fbbb4a7130" } new_table_name: "default.Table_057e8e16d3e54245b3a2986507ebe8b4" modify_external_catalogs: true
I20260812 01:50:40.475265 13506 tablet_bootstrap.cc:492] T 0872a7468f0241aa8a2a544a5a272abb P 3fa1f2b1b9b548df97a1878bfde765b5: Bootstrap starting.
I20260812 01:50:40.477411 13506 tablet_bootstrap.cc:654] T 0872a7468f0241aa8a2a544a5a272abb P 3fa1f2b1b9b548df97a1878bfde765b5: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:40.478341 13505 tablet_bootstrap.cc:492] T 0872a7468f0241aa8a2a544a5a272abb P 0ced0a6dbcf2486183c801a3a84594d0: Bootstrap starting.
I20260812 01:50:40.479184 13504 tablet_bootstrap.cc:492] T 0872a7468f0241aa8a2a544a5a272abb P e0adecc3c8034b71923a3a23c38549a9: Bootstrap starting.
I20260812 01:50:40.480219 13505 tablet_bootstrap.cc:654] T 0872a7468f0241aa8a2a544a5a272abb P 0ced0a6dbcf2486183c801a3a84594d0: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:40.481241 13504 tablet_bootstrap.cc:654] T 0872a7468f0241aa8a2a544a5a272abb P e0adecc3c8034b71923a3a23c38549a9: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:40.481835 12609 catalog_manager.cc:2200] created HMS catalog entry for table [id=aaf14e2a02484000ae521f9e08c5865e]
I20260812 01:50:40.489820 12609 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:46888 (request call id 21) took 1028 ms. Trace:
I20260812 01:50:40.490067 12609 rpcz_store.cc:276] 0812 01:50:39.461338 (+ 0us) service_pool.cc:167] Inserting onto call queue
0812 01:50:39.462786 (+ 1448us) service_pool.cc:224] Handling call
0812 01:50:39.617784 (+154998us) catalog_manager.cc:2127] Acquired catalog manager lock
0812 01:50:39.618362 (+ 578us) catalog_manager.cc:2173] Created new table and tablet info
0812 01:50:40.481765 (+863403us) catalog_manager.cc:2199] Created new table in HMS catalog
0812 01:50:40.489409 (+ 7644us) catalog_manager.cc:2233] Wrote table and tablets to system table
0812 01:50:40.489623 (+ 214us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0812 01:50:40.489761 (+ 138us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 01:50:40.482748 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 01:50:40.482900 (+ 152us) write_op.cc:432] Acquiring schema lock in shared mode
0812 01:50:40.482908 (+ 8us) write_op.cc:435] Acquired schema lock
0812 01:50:40.482912 (+ 4us) tablet.cc:662] Decoding operations
0812 01:50:40.483028 (+ 116us) write_op.cc:620] Acquiring the partition lock for write op
0812 01:50:40.483046 (+ 18us) write_op.cc:641] Partition lock acquired for write op
0812 01:50:40.483054 (+ 8us) tablet.cc:685] Acquiring locks for 2 operations
0812 01:50:40.483161 (+ 107us) tablet.cc:701] Row locks acquired
0812 01:50:40.483164 (+ 3us) write_op.cc:260] PREPARE: finished
0812 01:50:40.483216 (+ 52us) write_op.cc:270] Start()
0812 01:50:40.483264 (+ 48us) write_op.cc:276] Timestamp: P: 1786499440483181 usec, L: 0
0812 01:50:40.483270 (+ 6us) op_driver.cc:348] REPLICATION: starting
0812 01:50:40.483515 (+ 245us) log.cc:844] Serialized 432 byte log entry
0812 01:50:40.488338 (+ 4823us) op_driver.cc:464] REPLICATION: finished
0812 01:50:40.488505 (+ 167us) write_op.cc:301] APPLY: starting
0812 01:50:40.488527 (+ 22us) tablet.cc:1367] starting BulkCheckPresence
0812 01:50:40.488586 (+ 59us) tablet.cc:1370] finished BulkCheckPresence
0812 01:50:40.488618 (+ 32us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 01:50:40.489003 (+ 385us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 01:50:40.489054 (+ 51us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 01:50:40.489065 (+ 11us) write_op.cc:312] APPLY: finished
0812 01:50:40.489188 (+ 123us) log.cc:844] Serialized 28 byte log entry
0812 01:50:40.489265 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0812 01:50:40.489289 (+ 24us) write_op.cc:454] Released schema lock
0812 01:50:40.489297 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0812 01:50:40.489427 (+ 130us) write_op.cc:489] Releasing partition, row and schema locks
0812 01:50:40.489431 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":793296,"Hive Metastore.run_cpu_time_us":368,"Hive Metastore.run_wall_time_us":69519,"child_traces":[["op",{"apply.queue_time_us":104,"apply.run_cpu_time_us":886,"apply.run_wall_time_us":886,"num_ops":2,"prepare.queue_time_us":64,"prepare.run_cpu_time_us":916,"prepare.run_wall_time_us":915,"raft.queue_time_us":1165,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":331,"replication_time_us":5029}]]}
W20260812 01:50:40.496872 12600 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111) [suppressed 12 similar messages]
I20260812 01:50:40.497303 12609 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_f04e78d3952146c88cb523c551527e23" } new_table_name: "default.Table_4b1538154ea5463f90b1549ebc72d0f7" modify_external_catalogs: true
I20260812 01:50:40.506102 13343 tablet_service.cc:1511] Processing CreateTablet for tablet 22bdb35d65454d60847e4b9747b1a784 (DEFAULT_TABLE table=default.table_f6e57676e85d4df5b9e688ea19aa48f4 [id=aaf14e2a02484000ae521f9e08c5865e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.506701 13343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22bdb35d65454d60847e4b9747b1a784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.509048 13179 tablet_service.cc:1511] Processing CreateTablet for tablet 22bdb35d65454d60847e4b9747b1a784 (DEFAULT_TABLE table=default.table_f6e57676e85d4df5b9e688ea19aa48f4 [id=aaf14e2a02484000ae521f9e08c5865e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.509689 13179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22bdb35d65454d60847e4b9747b1a784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.513767 13011 tablet_service.cc:1511] Processing CreateTablet for tablet 22bdb35d65454d60847e4b9747b1a784 (DEFAULT_TABLE table=default.table_f6e57676e85d4df5b9e688ea19aa48f4 [id=aaf14e2a02484000ae521f9e08c5865e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.514467 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22bdb35d65454d60847e4b9747b1a784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.518201 13504 tablet_bootstrap.cc:492] T 0872a7468f0241aa8a2a544a5a272abb P e0adecc3c8034b71923a3a23c38549a9: No bootstrap required, opened a new log
I20260812 01:50:40.518457 13504 ts_tablet_manager.cc:1403] T 0872a7468f0241aa8a2a544a5a272abb P e0adecc3c8034b71923a3a23c38549a9: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.008s
I20260812 01:50:40.519433 13504 raft_consensus.cc:359] T 0872a7468f0241aa8a2a544a5a272abb P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.519776 13504 raft_consensus.cc:385] T 0872a7468f0241aa8a2a544a5a272abb P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:40.519939 13504 raft_consensus.cc:740] T 0872a7468f0241aa8a2a544a5a272abb P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0adecc3c8034b71923a3a23c38549a9, State: Initialized, Role: FOLLOWER
I20260812 01:50:40.520344 13504 consensus_queue.cc:260] T 0872a7468f0241aa8a2a544a5a272abb P e0adecc3c8034b71923a3a23c38549a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.522311 13505 tablet_bootstrap.cc:492] T 0872a7468f0241aa8a2a544a5a272abb P 0ced0a6dbcf2486183c801a3a84594d0: No bootstrap required, opened a new log
I20260812 01:50:40.522500 13505 ts_tablet_manager.cc:1403] T 0872a7468f0241aa8a2a544a5a272abb P 0ced0a6dbcf2486183c801a3a84594d0: Time spent bootstrapping tablet: real 0.044s user 0.000s sys 0.011s
I20260812 01:50:40.523452 13505 raft_consensus.cc:359] T 0872a7468f0241aa8a2a544a5a272abb P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.523705 13505 raft_consensus.cc:385] T 0872a7468f0241aa8a2a544a5a272abb P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:40.523821 13505 raft_consensus.cc:740] T 0872a7468f0241aa8a2a544a5a272abb P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ced0a6dbcf2486183c801a3a84594d0, State: Initialized, Role: FOLLOWER
I20260812 01:50:40.524163 13505 consensus_queue.cc:260] T 0872a7468f0241aa8a2a544a5a272abb P 0ced0a6dbcf2486183c801a3a84594d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.526087 13504 ts_tablet_manager.cc:1434] T 0872a7468f0241aa8a2a544a5a272abb P e0adecc3c8034b71923a3a23c38549a9: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260812 01:50:40.529992 13505 ts_tablet_manager.cc:1434] T 0872a7468f0241aa8a2a544a5a272abb P 0ced0a6dbcf2486183c801a3a84594d0: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260812 01:50:40.532052 13506 tablet_bootstrap.cc:492] T 0872a7468f0241aa8a2a544a5a272abb P 3fa1f2b1b9b548df97a1878bfde765b5: No bootstrap required, opened a new log
I20260812 01:50:40.532315 13506 ts_tablet_manager.cc:1403] T 0872a7468f0241aa8a2a544a5a272abb P 3fa1f2b1b9b548df97a1878bfde765b5: Time spent bootstrapping tablet: real 0.057s user 0.001s sys 0.011s
I20260812 01:50:40.533502 13506 raft_consensus.cc:359] T 0872a7468f0241aa8a2a544a5a272abb P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.533991 13505 tablet_bootstrap.cc:492] T 22bdb35d65454d60847e4b9747b1a784 P 0ced0a6dbcf2486183c801a3a84594d0: Bootstrap starting.
I20260812 01:50:40.536350 13505 tablet_bootstrap.cc:654] T 22bdb35d65454d60847e4b9747b1a784 P 0ced0a6dbcf2486183c801a3a84594d0: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:40.536530 13506 raft_consensus.cc:385] T 0872a7468f0241aa8a2a544a5a272abb P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:40.536793 13506 raft_consensus.cc:740] T 0872a7468f0241aa8a2a544a5a272abb P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa1f2b1b9b548df97a1878bfde765b5, State: Initialized, Role: FOLLOWER
I20260812 01:50:40.537432 13506 consensus_queue.cc:260] T 0872a7468f0241aa8a2a544a5a272abb P 3fa1f2b1b9b548df97a1878bfde765b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.538594 13506 ts_tablet_manager.cc:1434] T 0872a7468f0241aa8a2a544a5a272abb P 3fa1f2b1b9b548df97a1878bfde765b5: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260812 01:50:40.539057 13506 tablet_bootstrap.cc:492] T 22bdb35d65454d60847e4b9747b1a784 P 3fa1f2b1b9b548df97a1878bfde765b5: Bootstrap starting.
I20260812 01:50:40.540863 13504 tablet_bootstrap.cc:492] T 22bdb35d65454d60847e4b9747b1a784 P e0adecc3c8034b71923a3a23c38549a9: Bootstrap starting.
I20260812 01:50:40.543670 13504 tablet_bootstrap.cc:654] T 22bdb35d65454d60847e4b9747b1a784 P e0adecc3c8034b71923a3a23c38549a9: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:40.546566 13506 tablet_bootstrap.cc:654] T 22bdb35d65454d60847e4b9747b1a784 P 3fa1f2b1b9b548df97a1878bfde765b5: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:40.552136 13505 tablet_bootstrap.cc:492] T 22bdb35d65454d60847e4b9747b1a784 P 0ced0a6dbcf2486183c801a3a84594d0: No bootstrap required, opened a new log
I20260812 01:50:40.552394 13505 ts_tablet_manager.cc:1403] T 22bdb35d65454d60847e4b9747b1a784 P 0ced0a6dbcf2486183c801a3a84594d0: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.001s
I20260812 01:50:40.553447 13505 raft_consensus.cc:359] T 22bdb35d65454d60847e4b9747b1a784 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.553704 13505 raft_consensus.cc:385] T 22bdb35d65454d60847e4b9747b1a784 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:40.553804 13505 raft_consensus.cc:740] T 22bdb35d65454d60847e4b9747b1a784 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ced0a6dbcf2486183c801a3a84594d0, State: Initialized, Role: FOLLOWER
I20260812 01:50:40.554162 13505 consensus_queue.cc:260] T 22bdb35d65454d60847e4b9747b1a784 P 0ced0a6dbcf2486183c801a3a84594d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.554800 13504 tablet_bootstrap.cc:492] T 22bdb35d65454d60847e4b9747b1a784 P e0adecc3c8034b71923a3a23c38549a9: No bootstrap required, opened a new log
I20260812 01:50:40.555051 13504 ts_tablet_manager.cc:1403] T 22bdb35d65454d60847e4b9747b1a784 P e0adecc3c8034b71923a3a23c38549a9: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.003s
I20260812 01:50:40.556079 13504 raft_consensus.cc:359] T 22bdb35d65454d60847e4b9747b1a784 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.556386 13504 raft_consensus.cc:385] T 22bdb35d65454d60847e4b9747b1a784 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:40.556540 13504 raft_consensus.cc:740] T 22bdb35d65454d60847e4b9747b1a784 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0adecc3c8034b71923a3a23c38549a9, State: Initialized, Role: FOLLOWER
I20260812 01:50:40.556967 13504 consensus_queue.cc:260] T 22bdb35d65454d60847e4b9747b1a784 P e0adecc3c8034b71923a3a23c38549a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.558959 13505 ts_tablet_manager.cc:1434] T 22bdb35d65454d60847e4b9747b1a784 P 0ced0a6dbcf2486183c801a3a84594d0: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260812 01:50:40.560459 13504 ts_tablet_manager.cc:1434] T 22bdb35d65454d60847e4b9747b1a784 P e0adecc3c8034b71923a3a23c38549a9: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260812 01:50:40.564622 13506 tablet_bootstrap.cc:492] T 22bdb35d65454d60847e4b9747b1a784 P 3fa1f2b1b9b548df97a1878bfde765b5: No bootstrap required, opened a new log
I20260812 01:50:40.565542 13506 ts_tablet_manager.cc:1403] T 22bdb35d65454d60847e4b9747b1a784 P 3fa1f2b1b9b548df97a1878bfde765b5: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.003s
I20260812 01:50:40.566943 13506 raft_consensus.cc:359] T 22bdb35d65454d60847e4b9747b1a784 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.567492 13506 raft_consensus.cc:385] T 22bdb35d65454d60847e4b9747b1a784 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:40.567663 13506 raft_consensus.cc:740] T 22bdb35d65454d60847e4b9747b1a784 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa1f2b1b9b548df97a1878bfde765b5, State: Initialized, Role: FOLLOWER
I20260812 01:50:40.568110 13506 consensus_queue.cc:260] T 22bdb35d65454d60847e4b9747b1a784 P 3fa1f2b1b9b548df97a1878bfde765b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.569598 13506 ts_tablet_manager.cc:1434] T 22bdb35d65454d60847e4b9747b1a784 P 3fa1f2b1b9b548df97a1878bfde765b5: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260812 01:50:40.571647 12608 catalog_manager.cc:2200] created HMS catalog entry for table [id=5bd7338fec7d4410a97da1766eebf362]
I20260812 01:50:40.579345 12608 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:46888 (request call id 22) took 1117 ms. Trace:
I20260812 01:50:40.579501 12608 rpcz_store.cc:276] 0812 01:50:39.461466 (+ 0us) service_pool.cc:167] Inserting onto call queue
0812 01:50:39.461980 (+ 514us) service_pool.cc:224] Handling call
0812 01:50:39.619679 (+157699us) catalog_manager.cc:2127] Acquired catalog manager lock
0812 01:50:39.620288 (+ 609us) catalog_manager.cc:2173] Created new table and tablet info
0812 01:50:40.571583 (+951295us) catalog_manager.cc:2199] Created new table in HMS catalog
0812 01:50:40.579028 (+ 7445us) catalog_manager.cc:2233] Wrote table and tablets to system table
0812 01:50:40.579161 (+ 133us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0812 01:50:40.579294 (+ 133us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 01:50:40.572599 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 01:50:40.572740 (+ 141us) write_op.cc:432] Acquiring schema lock in shared mode
0812 01:50:40.572747 (+ 7us) write_op.cc:435] Acquired schema lock
0812 01:50:40.572750 (+ 3us) tablet.cc:662] Decoding operations
0812 01:50:40.572850 (+ 100us) write_op.cc:620] Acquiring the partition lock for write op
0812 01:50:40.572866 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0812 01:50:40.572871 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0812 01:50:40.572961 (+ 90us) tablet.cc:701] Row locks acquired
0812 01:50:40.572963 (+ 2us) write_op.cc:260] PREPARE: finished
0812 01:50:40.573009 (+ 46us) write_op.cc:270] Start()
0812 01:50:40.573053 (+ 44us) write_op.cc:276] Timestamp: P: 1786499440572967 usec, L: 0
0812 01:50:40.573057 (+ 4us) op_driver.cc:348] REPLICATION: starting
0812 01:50:40.573314 (+ 257us) log.cc:844] Serialized 432 byte log entry
0812 01:50:40.577829 (+ 4515us) op_driver.cc:464] REPLICATION: finished
0812 01:50:40.578035 (+ 206us) write_op.cc:301] APPLY: starting
0812 01:50:40.578055 (+ 20us) tablet.cc:1367] starting BulkCheckPresence
0812 01:50:40.578109 (+ 54us) tablet.cc:1370] finished BulkCheckPresence
0812 01:50:40.578138 (+ 29us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 01:50:40.578278 (+ 140us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 01:50:40.578323 (+ 45us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 01:50:40.578332 (+ 9us) write_op.cc:312] APPLY: finished
0812 01:50:40.578420 (+ 88us) log.cc:844] Serialized 28 byte log entry
0812 01:50:40.578494 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0812 01:50:40.578837 (+ 343us) write_op.cc:454] Released schema lock
0812 01:50:40.578846 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0812 01:50:40.578920 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0812 01:50:40.578925 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":860951,"Hive Metastore.run_cpu_time_us":384,"Hive Metastore.run_wall_time_us":89871,"child_traces":[["op",{"apply.queue_time_us":138,"apply.run_cpu_time_us":570,"apply.run_wall_time_us":881,"num_ops":2,"prepare.queue_time_us":100,"prepare.run_cpu_time_us":849,"prepare.run_wall_time_us":849,"raft.queue_time_us":1134,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":326,"replication_time_us":4731}]]}
I20260812 01:50:40.582871 13523 raft_consensus.cc:493] T 6efaedf1b58840de991c63a645e0dc39 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:40.583081 13523 raft_consensus.cc:515] T 6efaedf1b58840de991c63a645e0dc39 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.583983 13523 leader_election.cc:290] T 6efaedf1b58840de991c63a645e0dc39 P e0adecc3c8034b71923a3a23c38549a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765), 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:50:40.584861 13370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6efaedf1b58840de991c63a645e0dc39" candidate_uuid: "e0adecc3c8034b71923a3a23c38549a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ced0a6dbcf2486183c801a3a84594d0" is_pre_election: true
I20260812 01:50:40.585130 13370 raft_consensus.cc:2468] T 6efaedf1b58840de991c63a645e0dc39 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0adecc3c8034b71923a3a23c38549a9 in term 0.
I20260812 01:50:40.586097 13034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6efaedf1b58840de991c63a645e0dc39" candidate_uuid: "e0adecc3c8034b71923a3a23c38549a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" is_pre_election: true
I20260812 01:50:40.586375 13034 raft_consensus.cc:2468] T 6efaedf1b58840de991c63a645e0dc39 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0adecc3c8034b71923a3a23c38549a9 in term 0.
I20260812 01:50:40.587172 13125 leader_election.cc:304] T 6efaedf1b58840de991c63a645e0dc39 P e0adecc3c8034b71923a3a23c38549a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ced0a6dbcf2486183c801a3a84594d0, e0adecc3c8034b71923a3a23c38549a9; no voters:
I20260812 01:50:40.587925 13523 raft_consensus.cc:2804] T 6efaedf1b58840de991c63a645e0dc39 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:50:40.588060 13523 raft_consensus.cc:493] T 6efaedf1b58840de991c63a645e0dc39 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:50:40.588151 13523 raft_consensus.cc:3060] T 6efaedf1b58840de991c63a645e0dc39 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:40.591615 13523 raft_consensus.cc:515] T 6efaedf1b58840de991c63a645e0dc39 P e0adecc3c8034b71923a3a23c38549a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.594123 13034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6efaedf1b58840de991c63a645e0dc39" candidate_uuid: "e0adecc3c8034b71923a3a23c38549a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa1f2b1b9b548df97a1878bfde765b5"
I20260812 01:50:40.594381 13034 raft_consensus.cc:3060] T 6efaedf1b58840de991c63a645e0dc39 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:40.597797 13034 raft_consensus.cc:2468] T 6efaedf1b58840de991c63a645e0dc39 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0adecc3c8034b71923a3a23c38549a9 in term 1.
I20260812 01:50:40.598985 13127 leader_election.cc:304] T 6efaedf1b58840de991c63a645e0dc39 P e0adecc3c8034b71923a3a23c38549a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa1f2b1b9b548df97a1878bfde765b5, e0adecc3c8034b71923a3a23c38549a9; no voters:
I20260812 01:50:40.600380 12608 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_7bd2016211964bd680b0484ef89b4b4d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:40.604030 13011 tablet_service.cc:1511] Processing CreateTablet for tablet 7b799ee2aec842409248e21dfa769a52 (DEFAULT_TABLE table=default.table_8f0e075a075f49719ed6cce7b86a8fe8 [id=5bd7338fec7d4410a97da1766eebf362]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.604542 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b799ee2aec842409248e21dfa769a52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.609688 13343 tablet_service.cc:1511] Processing CreateTablet for tablet 7b799ee2aec842409248e21dfa769a52 (DEFAULT_TABLE table=default.table_8f0e075a075f49719ed6cce7b86a8fe8 [id=5bd7338fec7d4410a97da1766eebf362]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.610292 13343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b799ee2aec842409248e21dfa769a52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.611536 13523 leader_election.cc:290] T 6efaedf1b58840de991c63a645e0dc39 P e0adecc3c8034b71923a3a23c38549a9 [CANDIDATE]: Term 1 election: Requested vote from peers 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765), 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:50:40.611784 13523 raft_consensus.cc:493] T 22bdb35d65454d60847e4b9747b1a784 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:40.611933 13523 raft_consensus.cc:515] T 22bdb35d65454d60847e4b9747b1a784 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.612669 13523 leader_election.cc:290] T 22bdb35d65454d60847e4b9747b1a784 P e0adecc3c8034b71923a3a23c38549a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765), 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:50:40.612844 13523 raft_consensus.cc:2804] T 6efaedf1b58840de991c63a645e0dc39 P e0adecc3c8034b71923a3a23c38549a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:50:40.612991 13523 raft_consensus.cc:697] T 6efaedf1b58840de991c63a645e0dc39 P e0adecc3c8034b71923a3a23c38549a9 [term 1 LEADER]: Becoming Leader. State: Replica: e0adecc3c8034b71923a3a23c38549a9, State: Running, Role: LEADER
I20260812 01:50:40.617533 13523 consensus_queue.cc:237] T 6efaedf1b58840de991c63a645e0dc39 P e0adecc3c8034b71923a3a23c38549a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.621798 13506 tablet_bootstrap.cc:492] T 7b799ee2aec842409248e21dfa769a52 P 3fa1f2b1b9b548df97a1878bfde765b5: Bootstrap starting.
I20260812 01:50:40.623996 13505 tablet_bootstrap.cc:492] T 7b799ee2aec842409248e21dfa769a52 P 0ced0a6dbcf2486183c801a3a84594d0: Bootstrap starting.
I20260812 01:50:40.630638 13505 tablet_bootstrap.cc:654] T 7b799ee2aec842409248e21dfa769a52 P 0ced0a6dbcf2486183c801a3a84594d0: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:40.630713 13517 raft_consensus.cc:493] T 230f3a15dade4e7e8dffcc9afcbe61bf P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:40.630993 13517 raft_consensus.cc:515] T 230f3a15dade4e7e8dffcc9afcbe61bf P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.634171 13517 leader_election.cc:290] T 230f3a15dade4e7e8dffcc9afcbe61bf P 3fa1f2b1b9b548df97a1878bfde765b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853), 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:50:40.637869 13517 raft_consensus.cc:493] T 22bdb35d65454d60847e4b9747b1a784 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:40.638891 13517 raft_consensus.cc:515] T 22bdb35d65454d60847e4b9747b1a784 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.642732 13517 leader_election.cc:290] T 22bdb35d65454d60847e4b9747b1a784 P 3fa1f2b1b9b548df97a1878bfde765b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853), 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:50:40.653010 13505 tablet_bootstrap.cc:492] T 7b799ee2aec842409248e21dfa769a52 P 0ced0a6dbcf2486183c801a3a84594d0: No bootstrap required, opened a new log
I20260812 01:50:40.653298 13505 ts_tablet_manager.cc:1403] T 7b799ee2aec842409248e21dfa769a52 P 0ced0a6dbcf2486183c801a3a84594d0: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.012s
I20260812 01:50:40.654359 13505 raft_consensus.cc:359] T 7b799ee2aec842409248e21dfa769a52 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.654618 13505 raft_consensus.cc:385] T 7b799ee2aec842409248e21dfa769a52 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:40.654753 13505 raft_consensus.cc:740] T 7b799ee2aec842409248e21dfa769a52 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ced0a6dbcf2486183c801a3a84594d0, State: Initialized, Role: FOLLOWER
I20260812 01:50:40.655117 13505 consensus_queue.cc:260] T 7b799ee2aec842409248e21dfa769a52 P 0ced0a6dbcf2486183c801a3a84594d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.658869 13505 ts_tablet_manager.cc:1434] T 7b799ee2aec842409248e21dfa769a52 P 0ced0a6dbcf2486183c801a3a84594d0: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260812 01:50:40.661259 13506 tablet_bootstrap.cc:654] T 7b799ee2aec842409248e21dfa769a52 P 3fa1f2b1b9b548df97a1878bfde765b5: Neither blocks nor log segments found. Creating new log.
W20260812 01:50:40.666216 13127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.243.1:42765, user_credentials={real_user=slave}} blocked reactor thread for 67262.9us
I20260812 01:50:40.667719 13034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22bdb35d65454d60847e4b9747b1a784" candidate_uuid: "e0adecc3c8034b71923a3a23c38549a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" is_pre_election: true
I20260812 01:50:40.667989 13034 raft_consensus.cc:2468] T 22bdb35d65454d60847e4b9747b1a784 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0adecc3c8034b71923a3a23c38549a9 in term 0.
I20260812 01:50:40.669051 13370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230f3a15dade4e7e8dffcc9afcbe61bf" candidate_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ced0a6dbcf2486183c801a3a84594d0" is_pre_election: true
I20260812 01:50:40.669735 13370 raft_consensus.cc:2468] T 230f3a15dade4e7e8dffcc9afcbe61bf P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa1f2b1b9b548df97a1878bfde765b5 in term 0.
I20260812 01:50:40.670159 13369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22bdb35d65454d60847e4b9747b1a784" candidate_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ced0a6dbcf2486183c801a3a84594d0" is_pre_election: true
I20260812 01:50:40.670465 13369 raft_consensus.cc:2468] T 22bdb35d65454d60847e4b9747b1a784 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa1f2b1b9b548df97a1878bfde765b5 in term 0.
I20260812 01:50:40.671089 12952 leader_election.cc:304] T 230f3a15dade4e7e8dffcc9afcbe61bf P 3fa1f2b1b9b548df97a1878bfde765b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ced0a6dbcf2486183c801a3a84594d0, 3fa1f2b1b9b548df97a1878bfde765b5; no voters:
I20260812 01:50:40.671485 13533 raft_consensus.cc:493] T 7b799ee2aec842409248e21dfa769a52 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:40.671597 12952 leader_election.cc:304] T 22bdb35d65454d60847e4b9747b1a784 P 3fa1f2b1b9b548df97a1878bfde765b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ced0a6dbcf2486183c801a3a84594d0, 3fa1f2b1b9b548df97a1878bfde765b5; no voters:
I20260812 01:50:40.671656 13533 raft_consensus.cc:515] T 7b799ee2aec842409248e21dfa769a52 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.672130 13517 raft_consensus.cc:2804] T 230f3a15dade4e7e8dffcc9afcbe61bf P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:50:40.672364 13533 leader_election.cc:290] T 7b799ee2aec842409248e21dfa769a52 P 0ced0a6dbcf2486183c801a3a84594d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765), e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853)
I20260812 01:50:40.672398 13517 raft_consensus.cc:493] T 230f3a15dade4e7e8dffcc9afcbe61bf P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:50:40.672525 13517 raft_consensus.cc:3060] T 230f3a15dade4e7e8dffcc9afcbe61bf P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Advancing to term 1
W20260812 01:50:40.675074 13286 leader_election.cc:343] T 7b799ee2aec842409248e21dfa769a52 P 0ced0a6dbcf2486183c801a3a84594d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853): Not found: Tablet not found: 7b799ee2aec842409248e21dfa769a52
I20260812 01:50:40.675549 13034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b799ee2aec842409248e21dfa769a52" candidate_uuid: "0ced0a6dbcf2486183c801a3a84594d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" is_pre_election: true
W20260812 01:50:40.676465 13290 leader_election.cc:343] T 7b799ee2aec842409248e21dfa769a52 P 0ced0a6dbcf2486183c801a3a84594d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765): Illegal state: must be running to vote when last-logged opid is not known
I20260812 01:50:40.676623 13290 leader_election.cc:304] T 7b799ee2aec842409248e21dfa769a52 P 0ced0a6dbcf2486183c801a3a84594d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ced0a6dbcf2486183c801a3a84594d0; no voters: 3fa1f2b1b9b548df97a1878bfde765b5, e0adecc3c8034b71923a3a23c38549a9
I20260812 01:50:40.677197 13533 raft_consensus.cc:2749] T 7b799ee2aec842409248e21dfa769a52 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 01:50:40.678822 13560 raft_consensus.cc:2804] T 22bdb35d65454d60847e4b9747b1a784 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:50:40.678994 13560 raft_consensus.cc:493] T 22bdb35d65454d60847e4b9747b1a784 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:50:40.679199 13560 raft_consensus.cc:3060] T 22bdb35d65454d60847e4b9747b1a784 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Advancing to term 1
W20260812 01:50:40.680895 13525 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:50:40.681385 13525 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:50:40.681524 13525 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260812 01:50:40.683341 13517 raft_consensus.cc:515] T 230f3a15dade4e7e8dffcc9afcbe61bf P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.685127 13517 leader_election.cc:290] T 230f3a15dade4e7e8dffcc9afcbe61bf P 3fa1f2b1b9b548df97a1878bfde765b5 [CANDIDATE]: Term 1 election: Requested vote from peers e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853), 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:50:40.685303 13369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230f3a15dade4e7e8dffcc9afcbe61bf" candidate_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ced0a6dbcf2486183c801a3a84594d0"
I20260812 01:50:40.685539 13369 raft_consensus.cc:3060] T 230f3a15dade4e7e8dffcc9afcbe61bf P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:40.688894 13369 raft_consensus.cc:2468] T 230f3a15dade4e7e8dffcc9afcbe61bf P 0ced0a6dbcf2486183c801a3a84594d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa1f2b1b9b548df97a1878bfde765b5 in term 1.
I20260812 01:50:40.689733 12952 leader_election.cc:304] T 230f3a15dade4e7e8dffcc9afcbe61bf P 3fa1f2b1b9b548df97a1878bfde765b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ced0a6dbcf2486183c801a3a84594d0, 3fa1f2b1b9b548df97a1878bfde765b5; no voters:
I20260812 01:50:40.690665 13517 raft_consensus.cc:2804] T 230f3a15dade4e7e8dffcc9afcbe61bf P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:50:40.696228 12606 catalog_manager.cc:2200] created HMS catalog entry for table [id=1ea24853d5ae4ae9874c2ee442e9394c]
W20260812 01:50:40.698244 13525 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:50:40.698360 13525 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:50:40.698454 13525 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:50:40.698529 13525 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:50:40.701979 13517 raft_consensus.cc:697] T 230f3a15dade4e7e8dffcc9afcbe61bf P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 LEADER]: Becoming Leader. State: Replica: 3fa1f2b1b9b548df97a1878bfde765b5, State: Running, Role: LEADER
I20260812 01:50:40.701382 13127 leader_election.cc:304] T 22bdb35d65454d60847e4b9747b1a784 P e0adecc3c8034b71923a3a23c38549a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa1f2b1b9b548df97a1878bfde765b5, e0adecc3c8034b71923a3a23c38549a9; no voters:
I20260812 01:50:40.702579 13517 consensus_queue.cc:237] T 230f3a15dade4e7e8dffcc9afcbe61bf P 3fa1f2b1b9b548df97a1878bfde765b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.703212 13369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6efaedf1b58840de991c63a645e0dc39" candidate_uuid: "e0adecc3c8034b71923a3a23c38549a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ced0a6dbcf2486183c801a3a84594d0"
I20260812 01:50:40.703465 13369 raft_consensus.cc:3060] T 6efaedf1b58840de991c63a645e0dc39 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:40.706234 12606 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:46888 (request call id 24) took 1244 ms. Trace:
I20260812 01:50:40.706375 12606 rpcz_store.cc:276] 0812 01:50:39.461706 (+ 0us) service_pool.cc:167] Inserting onto call queue
0812 01:50:39.462338 (+ 632us) service_pool.cc:224] Handling call
0812 01:50:39.620928 (+158590us) catalog_manager.cc:2127] Acquired catalog manager lock
0812 01:50:39.621481 (+ 553us) catalog_manager.cc:2173] Created new table and tablet info
0812 01:50:40.696163 (+1074682us) catalog_manager.cc:2199] Created new table in HMS catalog
0812 01:50:40.705927 (+ 9764us) catalog_manager.cc:2233] Wrote table and tablets to system table
0812 01:50:40.706047 (+ 120us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0812 01:50:40.706184 (+ 137us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 01:50:40.697435 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 01:50:40.697567 (+ 132us) write_op.cc:432] Acquiring schema lock in shared mode
0812 01:50:40.697574 (+ 7us) write_op.cc:435] Acquired schema lock
0812 01:50:40.697577 (+ 3us) tablet.cc:662] Decoding operations
0812 01:50:40.697682 (+ 105us) write_op.cc:620] Acquiring the partition lock for write op
0812 01:50:40.697698 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0812 01:50:40.697703 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0812 01:50:40.697795 (+ 92us) tablet.cc:701] Row locks acquired
0812 01:50:40.697797 (+ 2us) write_op.cc:260] PREPARE: finished
0812 01:50:40.697845 (+ 48us) write_op.cc:270] Start()
0812 01:50:40.697886 (+ 41us) write_op.cc:276] Timestamp: P: 1786499440697793 usec, L: 0
0812 01:50:40.697889 (+ 3us) op_driver.cc:348] REPLICATION: starting
0812 01:50:40.698138 (+ 249us) log.cc:844] Serialized 432 byte log entry
0812 01:50:40.704259 (+ 6121us) op_driver.cc:464] REPLICATION: finished
0812 01:50:40.704417 (+ 158us) write_op.cc:301] APPLY: starting
0812 01:50:40.704447 (+ 30us) tablet.cc:1367] starting BulkCheckPresence
0812 01:50:40.704499 (+ 52us) tablet.cc:1370] finished BulkCheckPresence
0812 01:50:40.704536 (+ 37us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 01:50:40.704658 (+ 122us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 01:50:40.704701 (+ 43us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 01:50:40.704710 (+ 9us) write_op.cc:312] APPLY: finished
0812 01:50:40.704798 (+ 88us) log.cc:844] Serialized 28 byte log entry
0812 01:50:40.704883 (+ 85us) write_op.cc:489] Releasing partition, row and schema locks
0812 01:50:40.704906 (+ 23us) write_op.cc:454] Released schema lock
0812 01:50:40.704913 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0812 01:50:40.704994 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0812 01:50:40.704998 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":949718,"Hive Metastore.run_cpu_time_us":313,"Hive Metastore.run_wall_time_us":124225,"child_traces":[["op",{"apply.queue_time_us":105,"apply.run_cpu_time_us":568,"apply.run_wall_time_us":568,"num_ops":2,"prepare.queue_time_us":390,"prepare.run_cpu_time_us":842,"prepare.run_wall_time_us":842,"raft.queue_time_us":1060,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":263,"replication_time_us":6337}]]}
I20260812 01:50:40.707410 13369 raft_consensus.cc:2468] T 6efaedf1b58840de991c63a645e0dc39 P 0ced0a6dbcf2486183c801a3a84594d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0adecc3c8034b71923a3a23c38549a9 in term 1.
I20260812 01:50:40.708534 13369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22bdb35d65454d60847e4b9747b1a784" candidate_uuid: "e0adecc3c8034b71923a3a23c38549a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ced0a6dbcf2486183c801a3a84594d0" is_pre_election: true
I20260812 01:50:40.708799 13369 raft_consensus.cc:2468] T 22bdb35d65454d60847e4b9747b1a784 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0adecc3c8034b71923a3a23c38549a9 in term 0.
I20260812 01:50:40.710110 13179 tablet_service.cc:1511] Processing CreateTablet for tablet 7b799ee2aec842409248e21dfa769a52 (DEFAULT_TABLE table=default.table_8f0e075a075f49719ed6cce7b86a8fe8 [id=5bd7338fec7d4410a97da1766eebf362]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.711949 13179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b799ee2aec842409248e21dfa769a52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.719696 13525 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.243.20:42563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:35039
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.243.60:33215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.243.60
--webserver_port=45607
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 1d9153c248733781bf69132f2d094d9d3c92b2bc
build type FASTDEBUG
built by None at 12 Aug 2026 01:45:57 UTC on bdcb31816ec0
build id 13298
ASAN enabled
I20260812 01:50:40.722098 13343 tablet_service.cc:1511] Processing CreateTablet for tablet d093fe48bace45f6ba626a54d0ce0e12 (DEFAULT_TABLE table=default.table_6d36e1d186c948bf87645831e37e7b4d [id=1ea24853d5ae4ae9874c2ee442e9394c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.722445 13504 tablet_bootstrap.cc:492] T 7b799ee2aec842409248e21dfa769a52 P e0adecc3c8034b71923a3a23c38549a9: Bootstrap starting.
I20260812 01:50:40.722462 13525 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:50:40.722651 13343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d093fe48bace45f6ba626a54d0ce0e12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.724807 13504 tablet_bootstrap.cc:654] T 7b799ee2aec842409248e21dfa769a52 P e0adecc3c8034b71923a3a23c38549a9: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:40.725549 13525 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260812 01:50:40.726737 13011 tablet_service.cc:1511] Processing CreateTablet for tablet d093fe48bace45f6ba626a54d0ce0e12 (DEFAULT_TABLE table=default.table_6d36e1d186c948bf87645831e37e7b4d [id=1ea24853d5ae4ae9874c2ee442e9394c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.727233 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d093fe48bace45f6ba626a54d0ce0e12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.728679 13554 raft_consensus.cc:2804] T 22bdb35d65454d60847e4b9747b1a784 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:50:40.728822 13554 raft_consensus.cc:493] T 22bdb35d65454d60847e4b9747b1a784 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:50:40.729014 13554 raft_consensus.cc:3060] T 22bdb35d65454d60847e4b9747b1a784 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:40.733300 13179 tablet_service.cc:1511] Processing CreateTablet for tablet d093fe48bace45f6ba626a54d0ce0e12 (DEFAULT_TABLE table=default.table_6d36e1d186c948bf87645831e37e7b4d [id=1ea24853d5ae4ae9874c2ee442e9394c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.733929 13179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d093fe48bace45f6ba626a54d0ce0e12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.736060 12606 catalog_manager.cc:5719] T 6efaedf1b58840de991c63a645e0dc39 P e0adecc3c8034b71923a3a23c38549a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2). New cstate: current_term: 1 leader_uuid: "e0adecc3c8034b71923a3a23c38549a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } health_report { overall_health: UNKNOWN } } }
I20260812 01:50:40.683199 13560 raft_consensus.cc:515] T 22bdb35d65454d60847e4b9747b1a784 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.738483 13506 tablet_bootstrap.cc:492] T 7b799ee2aec842409248e21dfa769a52 P 3fa1f2b1b9b548df97a1878bfde765b5: No bootstrap required, opened a new log
I20260812 01:50:40.739871 13506 ts_tablet_manager.cc:1403] T 7b799ee2aec842409248e21dfa769a52 P 3fa1f2b1b9b548df97a1878bfde765b5: Time spent bootstrapping tablet: real 0.118s user 0.005s sys 0.000s
I20260812 01:50:40.742098 13369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22bdb35d65454d60847e4b9747b1a784" candidate_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ced0a6dbcf2486183c801a3a84594d0"
I20260812 01:50:40.743381 13369 raft_consensus.cc:3060] T 22bdb35d65454d60847e4b9747b1a784 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:40.742846 13505 tablet_bootstrap.cc:492] T d093fe48bace45f6ba626a54d0ce0e12 P 0ced0a6dbcf2486183c801a3a84594d0: Bootstrap starting.
I20260812 01:50:40.745400 13560 leader_election.cc:290] T 22bdb35d65454d60847e4b9747b1a784 P 3fa1f2b1b9b548df97a1878bfde765b5 [CANDIDATE]: Term 1 election: Requested vote from peers e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853), 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:50:40.746045 13505 tablet_bootstrap.cc:654] T d093fe48bace45f6ba626a54d0ce0e12 P 0ced0a6dbcf2486183c801a3a84594d0: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:40.746675 13504 tablet_bootstrap.cc:492] T 7b799ee2aec842409248e21dfa769a52 P e0adecc3c8034b71923a3a23c38549a9: No bootstrap required, opened a new log
I20260812 01:50:40.746994 13504 ts_tablet_manager.cc:1403] T 7b799ee2aec842409248e21dfa769a52 P e0adecc3c8034b71923a3a23c38549a9: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.002s
I20260812 01:50:40.748411 13504 raft_consensus.cc:359] T 7b799ee2aec842409248e21dfa769a52 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.748822 13504 raft_consensus.cc:385] T 7b799ee2aec842409248e21dfa769a52 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:40.749015 13504 raft_consensus.cc:740] T 7b799ee2aec842409248e21dfa769a52 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0adecc3c8034b71923a3a23c38549a9, State: Initialized, Role: FOLLOWER
I20260812 01:50:40.749512 13504 consensus_queue.cc:260] T 7b799ee2aec842409248e21dfa769a52 P e0adecc3c8034b71923a3a23c38549a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.754524 12606 catalog_manager.cc:5719] T 230f3a15dade4e7e8dffcc9afcbe61bf P 3fa1f2b1b9b548df97a1878bfde765b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1). New cstate: current_term: 1 leader_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } health_report { overall_health: UNKNOWN } } }
I20260812 01:50:40.760284 13369 raft_consensus.cc:2468] T 22bdb35d65454d60847e4b9747b1a784 P 0ced0a6dbcf2486183c801a3a84594d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa1f2b1b9b548df97a1878bfde765b5 in term 1.
I20260812 01:50:40.761400 13506 raft_consensus.cc:359] T 7b799ee2aec842409248e21dfa769a52 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.761904 13506 raft_consensus.cc:385] T 7b799ee2aec842409248e21dfa769a52 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:40.762141 13506 raft_consensus.cc:740] T 7b799ee2aec842409248e21dfa769a52 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa1f2b1b9b548df97a1878bfde765b5, State: Initialized, Role: FOLLOWER
I20260812 01:50:40.762689 13506 consensus_queue.cc:260] T 7b799ee2aec842409248e21dfa769a52 P 3fa1f2b1b9b548df97a1878bfde765b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.765111 13506 ts_tablet_manager.cc:1434] T 7b799ee2aec842409248e21dfa769a52 P 3fa1f2b1b9b548df97a1878bfde765b5: Time spent starting tablet: real 0.025s user 0.003s sys 0.000s
I20260812 01:50:40.766077 13506 tablet_bootstrap.cc:492] T d093fe48bace45f6ba626a54d0ce0e12 P 3fa1f2b1b9b548df97a1878bfde765b5: Bootstrap starting.
I20260812 01:50:40.769335 13504 ts_tablet_manager.cc:1434] T 7b799ee2aec842409248e21dfa769a52 P e0adecc3c8034b71923a3a23c38549a9: Time spent starting tablet: real 0.022s user 0.002s sys 0.001s
I20260812 01:50:40.779587 13202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230f3a15dade4e7e8dffcc9afcbe61bf" candidate_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0adecc3c8034b71923a3a23c38549a9" is_pre_election: true
I20260812 01:50:40.779932 13202 raft_consensus.cc:2468] T 230f3a15dade4e7e8dffcc9afcbe61bf P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa1f2b1b9b548df97a1878bfde765b5 in term 0.
I20260812 01:50:40.780979 13202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22bdb35d65454d60847e4b9747b1a784" candidate_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0adecc3c8034b71923a3a23c38549a9" is_pre_election: true
I20260812 01:50:40.782125 13201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230f3a15dade4e7e8dffcc9afcbe61bf" candidate_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0adecc3c8034b71923a3a23c38549a9"
I20260812 01:50:40.782734 13201 raft_consensus.cc:3060] T 230f3a15dade4e7e8dffcc9afcbe61bf P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:40.783473 13554 raft_consensus.cc:515] T 22bdb35d65454d60847e4b9747b1a784 P e0adecc3c8034b71923a3a23c38549a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.784073 13202 raft_consensus.cc:2393] T 22bdb35d65454d60847e4b9747b1a784 P e0adecc3c8034b71923a3a23c38549a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fa1f2b1b9b548df97a1878bfde765b5 in current term 1: Already voted for candidate e0adecc3c8034b71923a3a23c38549a9 in this term.
I20260812 01:50:40.786808 13201 raft_consensus.cc:2468] T 230f3a15dade4e7e8dffcc9afcbe61bf P e0adecc3c8034b71923a3a23c38549a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa1f2b1b9b548df97a1878bfde765b5 in term 1.
I20260812 01:50:40.787411 13200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22bdb35d65454d60847e4b9747b1a784" candidate_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0adecc3c8034b71923a3a23c38549a9"
I20260812 01:50:40.788120 13200 raft_consensus.cc:2393] T 22bdb35d65454d60847e4b9747b1a784 P e0adecc3c8034b71923a3a23c38549a9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3fa1f2b1b9b548df97a1878bfde765b5 in current term 1: Already voted for candidate e0adecc3c8034b71923a3a23c38549a9 in this term.
I20260812 01:50:40.788923 12606 master_service.cc:960] ReplaceTablet: received request to replace tablet 0dce52a81cf34fdb8f7798a28ec7bb33 from {username='slave'} at 127.0.0.1:46888
I20260812 01:50:40.775892 13505 tablet_bootstrap.cc:492] T d093fe48bace45f6ba626a54d0ce0e12 P 0ced0a6dbcf2486183c801a3a84594d0: No bootstrap required, opened a new log
I20260812 01:50:40.790648 13505 ts_tablet_manager.cc:1403] T d093fe48bace45f6ba626a54d0ce0e12 P 0ced0a6dbcf2486183c801a3a84594d0: Time spent bootstrapping tablet: real 0.048s user 0.001s sys 0.009s
I20260812 01:50:40.792074 13505 raft_consensus.cc:359] T d093fe48bace45f6ba626a54d0ce0e12 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.796152 13505 raft_consensus.cc:385] T d093fe48bace45f6ba626a54d0ce0e12 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:40.796382 13505 raft_consensus.cc:740] T d093fe48bace45f6ba626a54d0ce0e12 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ced0a6dbcf2486183c801a3a84594d0, State: Initialized, Role: FOLLOWER
I20260812 01:50:40.796937 13505 consensus_queue.cc:260] T d093fe48bace45f6ba626a54d0ce0e12 P 0ced0a6dbcf2486183c801a3a84594d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.800981 12606 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066: Sending DeleteTablet for 3 replicas of tablet 0dce52a81cf34fdb8f7798a28ec7bb33
I20260812 01:50:40.802641 13343 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dce52a81cf34fdb8f7798a28ec7bb33 with delete_type TABLET_DATA_DELETED (replaced by tablet 78507e1a5eb240038a518f5e279774d6) from {username='slave'} at 127.0.0.1:55990
I20260812 01:50:40.804184 13574 tablet_replica.cc:333] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0: stopping tablet replica
I20260812 01:50:40.805454 13574 raft_consensus.cc:2243] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:50:40.806468 13574 pending_rounds.cc:70] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0: Trying to abort 1 pending ops.
I20260812 01:50:40.807371 13178 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dce52a81cf34fdb8f7798a28ec7bb33 with delete_type TABLET_DATA_DELETED (replaced by tablet 78507e1a5eb240038a518f5e279774d6) from {username='slave'} at 127.0.0.1:58964
I20260812 01:50:40.807576 13574 pending_rounds.cc:77] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317501707802787840 op_type: NO_OP noop_request { }
I20260812 01:50:40.807940 13574 raft_consensus.cc:2889] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260812 01:50:40.808245 13574 raft_consensus.cc:2272] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:50:40.810074 12606 catalog_manager.cc:6807] ReplaceTablet: tablet 0dce52a81cf34fdb8f7798a28ec7bb33 deleted and replaced by tablet 78507e1a5eb240038a518f5e279774d6
I20260812 01:50:40.810763 13574 ts_tablet_manager.cc:1916] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:50:40.806500 13505 ts_tablet_manager.cc:1434] T d093fe48bace45f6ba626a54d0ce0e12 P 0ced0a6dbcf2486183c801a3a84594d0: Time spent starting tablet: real 0.016s user 0.003s sys 0.000s
I20260812 01:50:40.816906 13343 tablet_service.cc:1511] Processing CreateTablet for tablet 78507e1a5eb240038a518f5e279774d6 (DEFAULT_TABLE table=default.table_f04e78d3952146c88cb523c551527e23 [id=f4140461eb024e01ab55c03106c63a3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.817554 13343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78507e1a5eb240038a518f5e279774d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.822547 13177 tablet_service.cc:1511] Processing CreateTablet for tablet 78507e1a5eb240038a518f5e279774d6 (DEFAULT_TABLE table=default.table_f04e78d3952146c88cb523c551527e23 [id=f4140461eb024e01ab55c03106c63a3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.823565 13177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78507e1a5eb240038a518f5e279774d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.826887 13505 tablet_bootstrap.cc:492] T 78507e1a5eb240038a518f5e279774d6 P 0ced0a6dbcf2486183c801a3a84594d0: Bootstrap starting.
I20260812 01:50:40.802181 13011 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dce52a81cf34fdb8f7798a28ec7bb33 with delete_type TABLET_DATA_DELETED (replaced by tablet 78507e1a5eb240038a518f5e279774d6) from {username='slave'} at 127.0.0.1:38382
I20260812 01:50:40.822131 13010 tablet_service.cc:1511] Processing CreateTablet for tablet 78507e1a5eb240038a518f5e279774d6 (DEFAULT_TABLE table=default.table_f04e78d3952146c88cb523c551527e23 [id=f4140461eb024e01ab55c03106c63a3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.829672 13505 tablet_bootstrap.cc:654] T 78507e1a5eb240038a518f5e279774d6 P 0ced0a6dbcf2486183c801a3a84594d0: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:40.830184 13010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78507e1a5eb240038a518f5e279774d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.831161 12606 master_service.cc:960] ReplaceTablet: received request to replace tablet 0dce52a81cf34fdb8f7798a28ec7bb33 from {username='slave'} at 127.0.0.1:46888
I20260812 01:50:40.823235 12952 leader_election.cc:304] T 22bdb35d65454d60847e4b9747b1a784 P 3fa1f2b1b9b548df97a1878bfde765b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ced0a6dbcf2486183c801a3a84594d0, 3fa1f2b1b9b548df97a1878bfde765b5; no voters: e0adecc3c8034b71923a3a23c38549a9
I20260812 01:50:40.832697 13369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22bdb35d65454d60847e4b9747b1a784" candidate_uuid: "e0adecc3c8034b71923a3a23c38549a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ced0a6dbcf2486183c801a3a84594d0"
I20260812 01:50:40.832967 13560 raft_consensus.cc:2804] T 22bdb35d65454d60847e4b9747b1a784 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:50:40.833541 13369 raft_consensus.cc:2393] T 22bdb35d65454d60847e4b9747b1a784 P 0ced0a6dbcf2486183c801a3a84594d0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e0adecc3c8034b71923a3a23c38549a9 in current term 1: Already voted for candidate 3fa1f2b1b9b548df97a1878bfde765b5 in this term.
I20260812 01:50:40.834502 13034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22bdb35d65454d60847e4b9747b1a784" candidate_uuid: "e0adecc3c8034b71923a3a23c38549a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa1f2b1b9b548df97a1878bfde765b5"
I20260812 01:50:40.836221 13560 raft_consensus.cc:697] T 22bdb35d65454d60847e4b9747b1a784 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 LEADER]: Becoming Leader. State: Replica: 3fa1f2b1b9b548df97a1878bfde765b5, State: Running, Role: LEADER
I20260812 01:50:40.836711 13560 consensus_queue.cc:237] T 22bdb35d65454d60847e4b9747b1a784 P 3fa1f2b1b9b548df97a1878bfde765b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.836962 12606 master_service.cc:960] ReplaceTablet: received request to replace tablet 0dce52a81cf34fdb8f7798a28ec7bb33 from {username='slave'} at 127.0.0.1:46888
I20260812 01:50:40.841638 12606 master_service.cc:960] ReplaceTablet: received request to replace tablet 6663207a3bed43c1a34366d912e789a6 from {username='slave'} at 127.0.0.1:46888
I20260812 01:50:40.841746 13554 leader_election.cc:290] T 22bdb35d65454d60847e4b9747b1a784 P e0adecc3c8034b71923a3a23c38549a9 [CANDIDATE]: Term 1 election: Requested vote from peers 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765), 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:50:40.844731 13506 tablet_bootstrap.cc:654] T d093fe48bace45f6ba626a54d0ce0e12 P 3fa1f2b1b9b548df97a1878bfde765b5: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:40.850857 13576 tablet_replica.cc:333] T 0dce52a81cf34fdb8f7798a28ec7bb33 P e0adecc3c8034b71923a3a23c38549a9: stopping tablet replica
I20260812 01:50:40.851274 13576 raft_consensus.cc:2243] T 0dce52a81cf34fdb8f7798a28ec7bb33 P e0adecc3c8034b71923a3a23c38549a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:50:40.851863 13576 raft_consensus.cc:2272] T 0dce52a81cf34fdb8f7798a28ec7bb33 P e0adecc3c8034b71923a3a23c38549a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:50:40.852448 13533 raft_consensus.cc:493] T d093fe48bace45f6ba626a54d0ce0e12 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:40.852741 13533 raft_consensus.cc:515] T d093fe48bace45f6ba626a54d0ce0e12 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.853615 13533 leader_election.cc:290] T d093fe48bace45f6ba626a54d0ce0e12 P 0ced0a6dbcf2486183c801a3a84594d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853), 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765)
I20260812 01:50:40.854846 13504 tablet_bootstrap.cc:492] T 78507e1a5eb240038a518f5e279774d6 P e0adecc3c8034b71923a3a23c38549a9: Bootstrap starting.
W20260812 01:50:40.855394 13286 leader_election.cc:343] T d093fe48bace45f6ba626a54d0ce0e12 P 0ced0a6dbcf2486183c801a3a84594d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853): Not found: Tablet not found: d093fe48bace45f6ba626a54d0ce0e12
I20260812 01:50:40.856236 13554 raft_consensus.cc:493] T 0872a7468f0241aa8a2a544a5a272abb P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:40.856576 13554 raft_consensus.cc:515] T 0872a7468f0241aa8a2a544a5a272abb P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.857179 13505 tablet_bootstrap.cc:492] T 78507e1a5eb240038a518f5e279774d6 P 0ced0a6dbcf2486183c801a3a84594d0: No bootstrap required, opened a new log
I20260812 01:50:40.857481 13554 leader_election.cc:290] T 0872a7468f0241aa8a2a544a5a272abb P e0adecc3c8034b71923a3a23c38549a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765), 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:50:40.858733 13504 tablet_bootstrap.cc:654] T 78507e1a5eb240038a518f5e279774d6 P e0adecc3c8034b71923a3a23c38549a9: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:40.859261 12606 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066: Sending DeleteTablet for 3 replicas of tablet 6663207a3bed43c1a34366d912e789a6
I20260812 01:50:40.861677 13178 tablet_service.cc:1558] Processing DeleteTablet for tablet 6663207a3bed43c1a34366d912e789a6 with delete_type TABLET_DATA_DELETED (replaced by tablet ccd26ea0add54d46a423130dd1bc010f) from {username='slave'} at 127.0.0.1:58964
I20260812 01:50:40.860605 13343 tablet_service.cc:1558] Processing DeleteTablet for tablet 6663207a3bed43c1a34366d912e789a6 with delete_type TABLET_DATA_DELETED (replaced by tablet ccd26ea0add54d46a423130dd1bc010f) from {username='slave'} at 127.0.0.1:55990
I20260812 01:50:40.858940 13369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0872a7468f0241aa8a2a544a5a272abb" candidate_uuid: "e0adecc3c8034b71923a3a23c38549a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ced0a6dbcf2486183c801a3a84594d0" is_pre_election: true
I20260812 01:50:40.862227 13369 raft_consensus.cc:2468] T 0872a7468f0241aa8a2a544a5a272abb P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0adecc3c8034b71923a3a23c38549a9 in term 0.
I20260812 01:50:40.863045 13125 leader_election.cc:304] T 0872a7468f0241aa8a2a544a5a272abb P e0adecc3c8034b71923a3a23c38549a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ced0a6dbcf2486183c801a3a84594d0, e0adecc3c8034b71923a3a23c38549a9; no voters:
I20260812 01:50:40.863565 13554 raft_consensus.cc:2804] T 0872a7468f0241aa8a2a544a5a272abb P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:50:40.863785 13554 raft_consensus.cc:493] T 0872a7468f0241aa8a2a544a5a272abb P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:50:40.864123 13554 raft_consensus.cc:3060] T 0872a7468f0241aa8a2a544a5a272abb P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:40.865448 13505 ts_tablet_manager.cc:1403] T 78507e1a5eb240038a518f5e279774d6 P 0ced0a6dbcf2486183c801a3a84594d0: Time spent bootstrapping tablet: real 0.039s user 0.001s sys 0.005s
I20260812 01:50:40.857169 13033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d093fe48bace45f6ba626a54d0ce0e12" candidate_uuid: "0ced0a6dbcf2486183c801a3a84594d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" is_pre_election: true
I20260812 01:50:40.858346 13032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0872a7468f0241aa8a2a544a5a272abb" candidate_uuid: "e0adecc3c8034b71923a3a23c38549a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" is_pre_election: true
I20260812 01:50:40.866215 13032 raft_consensus.cc:2468] T 0872a7468f0241aa8a2a544a5a272abb P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0adecc3c8034b71923a3a23c38549a9 in term 0.
I20260812 01:50:40.860316 13009 tablet_service.cc:1558] Processing DeleteTablet for tablet 6663207a3bed43c1a34366d912e789a6 with delete_type TABLET_DATA_DELETED (replaced by tablet ccd26ea0add54d46a423130dd1bc010f) from {username='slave'} at 127.0.0.1:38382
I20260812 01:50:40.866935 13505 raft_consensus.cc:359] T 78507e1a5eb240038a518f5e279774d6 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.867216 13505 raft_consensus.cc:385] T 78507e1a5eb240038a518f5e279774d6 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:40.867369 13505 raft_consensus.cc:740] T 78507e1a5eb240038a518f5e279774d6 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ced0a6dbcf2486183c801a3a84594d0, State: Initialized, Role: FOLLOWER
W20260812 01:50:40.867544 13290 leader_election.cc:343] T d093fe48bace45f6ba626a54d0ce0e12 P 0ced0a6dbcf2486183c801a3a84594d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765): Illegal state: must be running to vote when last-logged opid is not known
I20260812 01:50:40.867707 13505 consensus_queue.cc:260] T 78507e1a5eb240038a518f5e279774d6 P 0ced0a6dbcf2486183c801a3a84594d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.867821 13290 leader_election.cc:304] T d093fe48bace45f6ba626a54d0ce0e12 P 0ced0a6dbcf2486183c801a3a84594d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ced0a6dbcf2486183c801a3a84594d0; no voters: 3fa1f2b1b9b548df97a1878bfde765b5, e0adecc3c8034b71923a3a23c38549a9
I20260812 01:50:40.868177 13577 tablet_replica.cc:333] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 3fa1f2b1b9b548df97a1878bfde765b5: stopping tablet replica
I20260812 01:50:40.868364 13505 ts_tablet_manager.cc:1434] T 78507e1a5eb240038a518f5e279774d6 P 0ced0a6dbcf2486183c801a3a84594d0: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20260812 01:50:40.868438 13577 raft_consensus.cc:2243] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:50:40.868463 13513 raft_consensus.cc:2749] T d093fe48bace45f6ba626a54d0ce0e12 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 01:50:40.868767 13577 raft_consensus.cc:2272] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:50:40.873128 13577 ts_tablet_manager.cc:1916] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 3fa1f2b1b9b548df97a1878bfde765b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:50:40.874586 12606 catalog_manager.cc:6807] ReplaceTablet: tablet 6663207a3bed43c1a34366d912e789a6 deleted and replaced by tablet ccd26ea0add54d46a423130dd1bc010f
I20260812 01:50:40.879484 12615 catalog_manager.cc:2200] created HMS catalog entry for table [id=c0f9109b45f942d9a4c6282519f618ec]
I20260812 01:50:40.880314 13576 ts_tablet_manager.cc:1916] T 0dce52a81cf34fdb8f7798a28ec7bb33 P e0adecc3c8034b71923a3a23c38549a9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:50:40.883582 13574 ts_tablet_manager.cc:1929] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 01:50:40.883793 13574 log.cc:1199] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0: Deleting WAL directory at /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-2/wal/wals/0dce52a81cf34fdb8f7798a28ec7bb33
I20260812 01:50:40.889339 13127 leader_election.cc:304] T 22bdb35d65454d60847e4b9747b1a784 P e0adecc3c8034b71923a3a23c38549a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e0adecc3c8034b71923a3a23c38549a9; no voters: 0ced0a6dbcf2486183c801a3a84594d0, 3fa1f2b1b9b548df97a1878bfde765b5
I20260812 01:50:40.891774 13577 ts_tablet_manager.cc:1929] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 3fa1f2b1b9b548df97a1878bfde765b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 01:50:40.891788 13523 raft_consensus.cc:2749] T 22bdb35d65454d60847e4b9747b1a784 P e0adecc3c8034b71923a3a23c38549a9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 01:50:40.892390 13574 ts_tablet_manager.cc:1950] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 0ced0a6dbcf2486183c801a3a84594d0: Deleting consensus metadata
I20260812 01:50:40.894074 13343 tablet_service.cc:1511] Processing CreateTablet for tablet ccd26ea0add54d46a423130dd1bc010f (DEFAULT_TABLE table=default.table_05e4335fa3134a3495c1c0a5f1cd4313 [id=51c4aa84d04240d3939355629be68e6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.894274 12599 catalog_manager.cc:5050] TS 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197): tablet 0dce52a81cf34fdb8f7798a28ec7bb33 (table default.table_f04e78d3952146c88cb523c551527e23 [id=f4140461eb024e01ab55c03106c63a3c]) successfully deleted
I20260812 01:50:40.894537 13343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccd26ea0add54d46a423130dd1bc010f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.895895 13574 tablet_replica.cc:333] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0: stopping tablet replica
I20260812 01:50:40.896529 13574 raft_consensus.cc:2243] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0 [term 1 LEADER]: Raft consensus shutting down.
I20260812 01:50:40.897358 13574 pending_rounds.cc:70] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0: Trying to abort 1 pending ops.
I20260812 01:50:40.897941 13574 pending_rounds.cc:77] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317501707002347520 op_type: NO_OP noop_request { }
I20260812 01:50:40.898399 13574 raft_consensus.cc:2889] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260812 01:50:40.898842 13574 raft_consensus.cc:2272] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:50:40.899256 12615 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:46888 (request call id 15) took 1439 ms. Trace:
I20260812 01:50:40.899376 12615 rpcz_store.cc:276] 0812 01:50:39.460233 (+ 0us) service_pool.cc:167] Inserting onto call queue
0812 01:50:39.460591 (+ 358us) service_pool.cc:224] Handling call
0812 01:50:39.621895 (+161304us) catalog_manager.cc:2127] Acquired catalog manager lock
0812 01:50:39.622650 (+ 755us) catalog_manager.cc:2173] Created new table and tablet info
0812 01:50:40.879400 (+1256750us) catalog_manager.cc:2199] Created new table in HMS catalog
0812 01:50:40.898935 (+ 19535us) catalog_manager.cc:2233] Wrote table and tablets to system table
0812 01:50:40.899058 (+ 123us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0812 01:50:40.899165 (+ 107us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0812 01:50:40.887456 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 01:50:40.887689 (+ 233us) write_op.cc:432] Acquiring schema lock in shared mode
0812 01:50:40.887698 (+ 9us) write_op.cc:435] Acquired schema lock
0812 01:50:40.887701 (+ 3us) tablet.cc:662] Decoding operations
0812 01:50:40.887819 (+ 118us) write_op.cc:620] Acquiring the partition lock for write op
0812 01:50:40.887836 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0812 01:50:40.887842 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0812 01:50:40.887938 (+ 96us) tablet.cc:701] Row locks acquired
0812 01:50:40.887940 (+ 2us) write_op.cc:260] PREPARE: finished
0812 01:50:40.887990 (+ 50us) write_op.cc:270] Start()
0812 01:50:40.888030 (+ 40us) write_op.cc:276] Timestamp: P: 1786499440887966 usec, L: 0
0812 01:50:40.888033 (+ 3us) op_driver.cc:348] REPLICATION: starting
0812 01:50:40.888362 (+ 329us) log.cc:844] Serialized 432 byte log entry
0812 01:50:40.898071 (+ 9709us) op_driver.cc:464] REPLICATION: finished
0812 01:50:40.898277 (+ 206us) write_op.cc:301] APPLY: starting
0812 01:50:40.898296 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0812 01:50:40.898347 (+ 51us) tablet.cc:1370] finished BulkCheckPresence
0812 01:50:40.898376 (+ 29us) tablet.cc:1372] starting ApplyRowOperation cycle
0812 01:50:40.898493 (+ 117us) tablet.cc:1383] finished ApplyRowOperation cycle
0812 01:50:40.898531 (+ 38us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 01:50:40.898539 (+ 8us) write_op.cc:312] APPLY: finished
0812 01:50:40.898643 (+ 104us) log.cc:844] Serialized 28 byte log entry
0812 01:50:40.898714 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0812 01:50:40.898736 (+ 22us) write_op.cc:454] Released schema lock
0812 01:50:40.898744 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0812 01:50:40.898824 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0812 01:50:40.898827 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1072777,"Hive Metastore.run_cpu_time_us":401,"Hive Metastore.run_wall_time_us":183685,"spinlock_wait_cycles":2432,"child_traces":[["op",{"apply.queue_time_us":150,"apply.run_cpu_time_us":539,"apply.run_wall_time_us":538,"num_ops":2,"prepare.queue_time_us":7242,"prepare.run_cpu_time_us":1054,"prepare.run_wall_time_us":1054,"raft.queue_time_us":483,"raft.run_cpu_time_us":10,"raft.run_wall_time_us":11,"replication_time_us":9986}]]}
I20260812 01:50:40.900553 13577 log.cc:1199] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 3fa1f2b1b9b548df97a1878bfde765b5: Deleting WAL directory at /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-0/wal/wals/0dce52a81cf34fdb8f7798a28ec7bb33
I20260812 01:50:40.901135 13577 ts_tablet_manager.cc:1950] T 0dce52a81cf34fdb8f7798a28ec7bb33 P 3fa1f2b1b9b548df97a1878bfde765b5: Deleting consensus metadata
I20260812 01:50:40.902302 13574 ts_tablet_manager.cc:1916] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:50:40.903623 13554 raft_consensus.cc:515] T 0872a7468f0241aa8a2a544a5a272abb P e0adecc3c8034b71923a3a23c38549a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.903733 12615 catalog_manager.cc:5719] T 22bdb35d65454d60847e4b9747b1a784 P 3fa1f2b1b9b548df97a1878bfde765b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1). New cstate: current_term: 1 leader_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } health_report { overall_health: UNKNOWN } } }
F20260812 01:50:40.905339 12927 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 1, previous 1; dumping first 2 out of 10 received events: NotificationEvent(eventId=1, eventTime=1786499439, eventType=CREATE_TABLE, dbName=default, tableName=table_05e4335fa3134a3495c1c0a5f1cd4313, message={"server":"","servicePrincipal":"","db":"default","table":"table_05e4335fa3134a3495c1c0a5f1cd4313","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_05e4335fa3134a3495c1c0a5f1cd4313\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786499439},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/warehouse/table_05e4335fa3134a3495c1c0a5f1cd4313\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_05e4335fa3134a3495c1c0a5f1cd4313\",\"kudu.table_id\":\"51c4aa84d04240d3939355629be68e6c\",\"transient_lastDdlTime\":\"1786499439\",\"comment\":\"\",\"kudu.master_addresses\":\"127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"4d89e47244e04cbeb6aca21d5d476cc2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786499439,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=1, eventTime=1786499439, eventType=CREATE_TABLE, dbName=default, tableName=table_6896943d0549474caa2928d9fd085a3a, message={"server":"","servicePrincipal":"","db":"default","table":"table_6896943d0549474caa2928d9fd085a3a","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_6896943d0549474caa2928d9fd085a3a\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786499439},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/warehouse/table_6896943d0549474caa2928d9fd085a3a\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_6896943d0549474caa2928d9fd085a3a\",\"kudu.table_id\":\"93dd830dcb7544e58258e468f73fb54a\",\"transient_lastDdlTime\":\"1786499439\",\"comment\":\"\",\"kudu.master_addresses\":\"127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"4d89e47244e04cbeb6aca21d5d476cc2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786499439,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20260812 01:50:40.892432 13011 tablet_service.cc:1511] Processing CreateTablet for tablet ccd26ea0add54d46a423130dd1bc010f (DEFAULT_TABLE table=default.table_05e4335fa3134a3495c1c0a5f1cd4313 [id=51c4aa84d04240d3939355629be68e6c]), partition=RANGE (key) PARTITION UNBOUNDED
@ 0x7f1fcb502d5d google::LogMessage::Fail() at ??:0
I20260812 01:50:40.910386 13034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0872a7468f0241aa8a2a544a5a272abb" candidate_uuid: "e0adecc3c8034b71923a3a23c38549a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa1f2b1b9b548df97a1878bfde765b5"
I20260812 01:50:40.910658 13034 raft_consensus.cc:3060] T 0872a7468f0241aa8a2a544a5a272abb P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Advancing to term 1
@ 0x7f1fcb506b23 google::LogMessage::SendToLog() at ??:0
@ 0x7f1fcb50275c google::LogMessage::Flush() at ??:0
I20260812 01:50:40.914225 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccd26ea0add54d46a423130dd1bc010f. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f1fcb5029a1 google::LogMessage::~LogMessage() at ??:0
I20260812 01:50:40.917533 13034 raft_consensus.cc:2468] T 0872a7468f0241aa8a2a544a5a272abb P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0adecc3c8034b71923a3a23c38549a9 in term 1.
I20260812 01:50:40.918581 13504 tablet_bootstrap.cc:492] T 78507e1a5eb240038a518f5e279774d6 P e0adecc3c8034b71923a3a23c38549a9: No bootstrap required, opened a new log
I20260812 01:50:40.919638 13506 tablet_bootstrap.cc:492] T d093fe48bace45f6ba626a54d0ce0e12 P 3fa1f2b1b9b548df97a1878bfde765b5: No bootstrap required, opened a new log
I20260812 01:50:40.920509 12615 master_service.cc:960] ReplaceTablet: received request to replace tablet 0dce52a81cf34fdb8f7798a28ec7bb33 from {username='slave'} at 127.0.0.1:46888
I20260812 01:50:40.921996 12615 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_fce810b18eef421f8cb8d4fffce6a188" } new_table_name: "default.Table_a1b47969379246018930d18eb3fcce51" modify_external_catalogs: true
I20260812 01:50:40.924013 13009 tablet_service.cc:1511] Processing CreateTablet for tablet 65a3f8ef595c4beba8a6f53ff0091349 (DEFAULT_TABLE table=default.table_d3455b8ae1274ff0ab8eaf05f61734ba [id=c0f9109b45f942d9a4c6282519f618ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.925259 13506 ts_tablet_manager.cc:1403] T d093fe48bace45f6ba626a54d0ce0e12 P 3fa1f2b1b9b548df97a1878bfde765b5: Time spent bootstrapping tablet: real 0.154s user 0.004s sys 0.001s
I20260812 01:50:40.925638 13009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65a3f8ef595c4beba8a6f53ff0091349. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.926329 13506 raft_consensus.cc:359] T d093fe48bace45f6ba626a54d0ce0e12 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.926762 13506 raft_consensus.cc:385] T d093fe48bace45f6ba626a54d0ce0e12 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:40.926981 13506 raft_consensus.cc:740] T d093fe48bace45f6ba626a54d0ce0e12 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa1f2b1b9b548df97a1878bfde765b5, State: Initialized, Role: FOLLOWER
I20260812 01:50:40.927345 13506 consensus_queue.cc:260] T d093fe48bace45f6ba626a54d0ce0e12 P 3fa1f2b1b9b548df97a1878bfde765b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.928049 13506 ts_tablet_manager.cc:1434] T d093fe48bace45f6ba626a54d0ce0e12 P 3fa1f2b1b9b548df97a1878bfde765b5: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20260812 01:50:40.928500 13506 tablet_bootstrap.cc:492] T 78507e1a5eb240038a518f5e279774d6 P 3fa1f2b1b9b548df97a1878bfde765b5: Bootstrap starting.
I20260812 01:50:40.930374 13127 leader_election.cc:304] T 0872a7468f0241aa8a2a544a5a272abb P e0adecc3c8034b71923a3a23c38549a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa1f2b1b9b548df97a1878bfde765b5, e0adecc3c8034b71923a3a23c38549a9; no voters:
I20260812 01:50:40.930900 13506 tablet_bootstrap.cc:654] T 78507e1a5eb240038a518f5e279774d6 P 3fa1f2b1b9b548df97a1878bfde765b5: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:40.930893 13523 raft_consensus.cc:2804] T 0872a7468f0241aa8a2a544a5a272abb P e0adecc3c8034b71923a3a23c38549a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:50:40.933280 13523 raft_consensus.cc:697] T 0872a7468f0241aa8a2a544a5a272abb P e0adecc3c8034b71923a3a23c38549a9 [term 1 LEADER]: Becoming Leader. State: Replica: e0adecc3c8034b71923a3a23c38549a9, State: Running, Role: LEADER
I20260812 01:50:40.933715 13369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0872a7468f0241aa8a2a544a5a272abb" candidate_uuid: "e0adecc3c8034b71923a3a23c38549a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ced0a6dbcf2486183c801a3a84594d0"
I20260812 01:50:40.934125 13369 raft_consensus.cc:3060] T 0872a7468f0241aa8a2a544a5a272abb P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:40.934090 13523 consensus_queue.cc:237] T 0872a7468f0241aa8a2a544a5a272abb P e0adecc3c8034b71923a3a23c38549a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.936017 13504 ts_tablet_manager.cc:1403] T 78507e1a5eb240038a518f5e279774d6 P e0adecc3c8034b71923a3a23c38549a9: Time spent bootstrapping tablet: real 0.064s user 0.008s sys 0.001s
I20260812 01:50:40.937171 13554 leader_election.cc:290] T 0872a7468f0241aa8a2a544a5a272abb P e0adecc3c8034b71923a3a23c38549a9 [CANDIDATE]: Term 1 election: Requested vote from peers 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765), 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:50:40.938431 13504 raft_consensus.cc:359] T 78507e1a5eb240038a518f5e279774d6 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.938663 13504 raft_consensus.cc:385] T 78507e1a5eb240038a518f5e279774d6 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:40.938783 13504 raft_consensus.cc:740] T 78507e1a5eb240038a518f5e279774d6 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0adecc3c8034b71923a3a23c38549a9, State: Initialized, Role: FOLLOWER
I20260812 01:50:40.939062 13504 consensus_queue.cc:260] T 78507e1a5eb240038a518f5e279774d6 P e0adecc3c8034b71923a3a23c38549a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.939705 13504 ts_tablet_manager.cc:1434] T 78507e1a5eb240038a518f5e279774d6 P e0adecc3c8034b71923a3a23c38549a9: Time spent starting tablet: real 0.004s user 0.000s sys 0.000s
I20260812 01:50:40.940152 13504 tablet_bootstrap.cc:492] T d093fe48bace45f6ba626a54d0ce0e12 P e0adecc3c8034b71923a3a23c38549a9: Bootstrap starting.
I20260812 01:50:40.940385 13177 tablet_service.cc:1511] Processing CreateTablet for tablet 65a3f8ef595c4beba8a6f53ff0091349 (DEFAULT_TABLE table=default.table_d3455b8ae1274ff0ab8eaf05f61734ba [id=c0f9109b45f942d9a4c6282519f618ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.941067 13177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65a3f8ef595c4beba8a6f53ff0091349. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.943302 13504 tablet_bootstrap.cc:654] T d093fe48bace45f6ba626a54d0ce0e12 P e0adecc3c8034b71923a3a23c38549a9: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:40.953512 13179 tablet_service.cc:1511] Processing CreateTablet for tablet ccd26ea0add54d46a423130dd1bc010f (DEFAULT_TABLE table=default.table_05e4335fa3134a3495c1c0a5f1cd4313 [id=51c4aa84d04240d3939355629be68e6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.954042 13179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccd26ea0add54d46a423130dd1bc010f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.953644 12606 catalog_manager.cc:5719] T 0872a7468f0241aa8a2a544a5a272abb P e0adecc3c8034b71923a3a23c38549a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2). New cstate: current_term: 1 leader_uuid: "e0adecc3c8034b71923a3a23c38549a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } health_report { overall_health: UNKNOWN } } }
I20260812 01:50:40.957369 13576 ts_tablet_manager.cc:1929] T 0dce52a81cf34fdb8f7798a28ec7bb33 P e0adecc3c8034b71923a3a23c38549a9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 01:50:40.957553 13576 log.cc:1199] T 0dce52a81cf34fdb8f7798a28ec7bb33 P e0adecc3c8034b71923a3a23c38549a9: Deleting WAL directory at /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-1/wal/wals/0dce52a81cf34fdb8f7798a28ec7bb33
I20260812 01:50:40.958103 13576 ts_tablet_manager.cc:1950] T 0dce52a81cf34fdb8f7798a28ec7bb33 P e0adecc3c8034b71923a3a23c38549a9: Deleting consensus metadata
I20260812 01:50:40.958905 13369 raft_consensus.cc:2468] T 0872a7468f0241aa8a2a544a5a272abb P 0ced0a6dbcf2486183c801a3a84594d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0adecc3c8034b71923a3a23c38549a9 in term 1.
I20260812 01:50:40.959414 13576 tablet_replica.cc:333] T 6663207a3bed43c1a34366d912e789a6 P e0adecc3c8034b71923a3a23c38549a9: stopping tablet replica
I20260812 01:50:40.959753 13576 raft_consensus.cc:2243] T 6663207a3bed43c1a34366d912e789a6 P e0adecc3c8034b71923a3a23c38549a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:50:40.960063 13576 raft_consensus.cc:2272] T 6663207a3bed43c1a34366d912e789a6 P e0adecc3c8034b71923a3a23c38549a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:50:40.960837 13576 ts_tablet_manager.cc:1916] T 6663207a3bed43c1a34366d912e789a6 P e0adecc3c8034b71923a3a23c38549a9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 01:50:40.960953 13582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:50:40.962049 13505 tablet_bootstrap.cc:492] T ccd26ea0add54d46a423130dd1bc010f P 0ced0a6dbcf2486183c801a3a84594d0: Bootstrap starting.
W20260812 01:50:40.962512 13585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:50:40.962909 12599 catalog_manager.cc:5050] TS e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853): tablet 0dce52a81cf34fdb8f7798a28ec7bb33 (table default.table_f04e78d3952146c88cb523c551527e23 [id=f4140461eb024e01ab55c03106c63a3c]) successfully deleted
I20260812 01:50:40.964588 13505 tablet_bootstrap.cc:654] T ccd26ea0add54d46a423130dd1bc010f P 0ced0a6dbcf2486183c801a3a84594d0: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:40.964663 13574 ts_tablet_manager.cc:1929] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 01:50:40.964815 13574 log.cc:1199] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0: Deleting WAL directory at /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-2/wal/wals/6663207a3bed43c1a34366d912e789a6
I20260812 01:50:40.966226 13574 ts_tablet_manager.cc:1950] T 6663207a3bed43c1a34366d912e789a6 P 0ced0a6dbcf2486183c801a3a84594d0: Deleting consensus metadata
I20260812 01:50:40.966842 13343 tablet_service.cc:1511] Processing CreateTablet for tablet 65a3f8ef595c4beba8a6f53ff0091349 (DEFAULT_TABLE table=default.table_d3455b8ae1274ff0ab8eaf05f61734ba [id=c0f9109b45f942d9a4c6282519f618ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 01:50:40.967335 13343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65a3f8ef595c4beba8a6f53ff0091349. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 01:50:40.967732 12599 catalog_manager.cc:5050] TS 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197): tablet 6663207a3bed43c1a34366d912e789a6 (table default.table_05e4335fa3134a3495c1c0a5f1cd4313 [id=51c4aa84d04240d3939355629be68e6c]) successfully deleted
W20260812 01:50:40.969604 13590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:50:40.970517 13525 server_base.cc:1061] running on GCE node
I20260812 01:50:40.971911 13525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:50:40.974902 12601 catalog_manager.cc:5050] TS 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765): tablet 0dce52a81cf34fdb8f7798a28ec7bb33 (table default.table_f04e78d3952146c88cb523c551527e23 [id=f4140461eb024e01ab55c03106c63a3c]) successfully deleted
I20260812 01:50:40.975283 13577 tablet_replica.cc:333] T 6663207a3bed43c1a34366d912e789a6 P 3fa1f2b1b9b548df97a1878bfde765b5: stopping tablet replica
I20260812 01:50:40.975651 13577 raft_consensus.cc:2243] T 6663207a3bed43c1a34366d912e789a6 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 01:50:40.975955 13577 raft_consensus.cc:2272] T 6663207a3bed43c1a34366d912e789a6 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 01:50:40.976650 13577 ts_tablet_manager.cc:1916] T 6663207a3bed43c1a34366d912e789a6 P 3fa1f2b1b9b548df97a1878bfde765b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 01:50:40.985811 13576 ts_tablet_manager.cc:1929] T 6663207a3bed43c1a34366d912e789a6 P e0adecc3c8034b71923a3a23c38549a9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 01:50:40.985999 13576 log.cc:1199] T 6663207a3bed43c1a34366d912e789a6 P e0adecc3c8034b71923a3a23c38549a9: Deleting WAL directory at /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-1/wal/wals/6663207a3bed43c1a34366d912e789a6
I20260812 01:50:40.986454 13576 ts_tablet_manager.cc:1950] T 6663207a3bed43c1a34366d912e789a6 P e0adecc3c8034b71923a3a23c38549a9: Deleting consensus metadata
I20260812 01:50:40.989468 12599 catalog_manager.cc:5050] TS e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853): tablet 6663207a3bed43c1a34366d912e789a6 (table default.table_05e4335fa3134a3495c1c0a5f1cd4313 [id=51c4aa84d04240d3939355629be68e6c]) successfully deleted
I20260812 01:50:40.992885 13577 ts_tablet_manager.cc:1929] T 6663207a3bed43c1a34366d912e789a6 P 3fa1f2b1b9b548df97a1878bfde765b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 01:50:40.993076 13577 log.cc:1199] T 6663207a3bed43c1a34366d912e789a6 P 3fa1f2b1b9b548df97a1878bfde765b5: Deleting WAL directory at /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/ts-0/wal/wals/6663207a3bed43c1a34366d912e789a6
I20260812 01:50:40.993963 13525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:50:40.995460 13506 tablet_bootstrap.cc:492] T 78507e1a5eb240038a518f5e279774d6 P 3fa1f2b1b9b548df97a1878bfde765b5: No bootstrap required, opened a new log
I20260812 01:50:40.995644 13506 ts_tablet_manager.cc:1403] T 78507e1a5eb240038a518f5e279774d6 P 3fa1f2b1b9b548df97a1878bfde765b5: Time spent bootstrapping tablet: real 0.067s user 0.007s sys 0.002s
I20260812 01:50:40.995975 13525 hybrid_clock.cc:648] HybridClock initialized: now 1786499440995881 us; error 94 us; skew 500 ppm
I20260812 01:50:40.996501 13525 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:50:40.996719 13506 raft_consensus.cc:359] T 78507e1a5eb240038a518f5e279774d6 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.997079 13506 raft_consensus.cc:385] T 78507e1a5eb240038a518f5e279774d6 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:40.997354 13506 raft_consensus.cc:740] T 78507e1a5eb240038a518f5e279774d6 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa1f2b1b9b548df97a1878bfde765b5, State: Initialized, Role: FOLLOWER
I20260812 01:50:40.997711 13506 consensus_queue.cc:260] T 78507e1a5eb240038a518f5e279774d6 P 3fa1f2b1b9b548df97a1878bfde765b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:40.998446 13577 ts_tablet_manager.cc:1950] T 6663207a3bed43c1a34366d912e789a6 P 3fa1f2b1b9b548df97a1878bfde765b5: Deleting consensus metadata
I20260812 01:50:41.000676 13506 ts_tablet_manager.cc:1434] T 78507e1a5eb240038a518f5e279774d6 P 3fa1f2b1b9b548df97a1878bfde765b5: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260812 01:50:41.001019 13504 tablet_bootstrap.cc:492] T d093fe48bace45f6ba626a54d0ce0e12 P e0adecc3c8034b71923a3a23c38549a9: No bootstrap required, opened a new log
I20260812 01:50:41.001271 13504 ts_tablet_manager.cc:1403] T d093fe48bace45f6ba626a54d0ce0e12 P e0adecc3c8034b71923a3a23c38549a9: Time spent bootstrapping tablet: real 0.061s user 0.002s sys 0.009s
I20260812 01:50:41.002388 13504 raft_consensus.cc:359] T d093fe48bace45f6ba626a54d0ce0e12 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.002642 13504 raft_consensus.cc:385] T d093fe48bace45f6ba626a54d0ce0e12 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:41.002794 13504 raft_consensus.cc:740] T d093fe48bace45f6ba626a54d0ce0e12 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0adecc3c8034b71923a3a23c38549a9, State: Initialized, Role: FOLLOWER
I20260812 01:50:41.003175 13504 consensus_queue.cc:260] T d093fe48bace45f6ba626a54d0ce0e12 P e0adecc3c8034b71923a3a23c38549a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.009545 13504 ts_tablet_manager.cc:1434] T d093fe48bace45f6ba626a54d0ce0e12 P e0adecc3c8034b71923a3a23c38549a9: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260812 01:50:41.014446 13505 tablet_bootstrap.cc:492] T ccd26ea0add54d46a423130dd1bc010f P 0ced0a6dbcf2486183c801a3a84594d0: No bootstrap required, opened a new log
I20260812 01:50:41.014672 13504 tablet_bootstrap.cc:492] T 65a3f8ef595c4beba8a6f53ff0091349 P e0adecc3c8034b71923a3a23c38549a9: Bootstrap starting.
I20260812 01:50:41.014703 13505 ts_tablet_manager.cc:1403] T ccd26ea0add54d46a423130dd1bc010f P 0ced0a6dbcf2486183c801a3a84594d0: Time spent bootstrapping tablet: real 0.053s user 0.004s sys 0.000s
I20260812 01:50:41.015862 13505 raft_consensus.cc:359] T ccd26ea0add54d46a423130dd1bc010f P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.016189 13505 raft_consensus.cc:385] T ccd26ea0add54d46a423130dd1bc010f P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:41.016285 13505 raft_consensus.cc:740] T ccd26ea0add54d46a423130dd1bc010f P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ced0a6dbcf2486183c801a3a84594d0, State: Initialized, Role: FOLLOWER
I20260812 01:50:41.016623 13505 consensus_queue.cc:260] T ccd26ea0add54d46a423130dd1bc010f P 0ced0a6dbcf2486183c801a3a84594d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.017620 13505 ts_tablet_manager.cc:1434] T ccd26ea0add54d46a423130dd1bc010f P 0ced0a6dbcf2486183c801a3a84594d0: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260812 01:50:41.022715 13533 raft_consensus.cc:493] T ccd26ea0add54d46a423130dd1bc010f P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:41.022998 13533 raft_consensus.cc:515] T ccd26ea0add54d46a423130dd1bc010f P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.024075 13533 leader_election.cc:290] T ccd26ea0add54d46a423130dd1bc010f P 0ced0a6dbcf2486183c801a3a84594d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765), e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853)
I20260812 01:50:41.024953 13200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd26ea0add54d46a423130dd1bc010f" candidate_uuid: "0ced0a6dbcf2486183c801a3a84594d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0adecc3c8034b71923a3a23c38549a9" is_pre_election: true
W20260812 01:50:41.027928 13286 leader_election.cc:343] T ccd26ea0add54d46a423130dd1bc010f P 0ced0a6dbcf2486183c801a3a84594d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260812 01:50:41.029500 13525 webserver.cc:533] Webserver started at http://127.11.243.60:45607/ using document root <none> and password file <none>
I20260812 01:50:41.030774 13525 fs_manager.cc:362] Metadata directory not provided
I20260812 01:50:41.030946 13525 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:50:41.032609 13504 tablet_bootstrap.cc:654] T 65a3f8ef595c4beba8a6f53ff0091349 P e0adecc3c8034b71923a3a23c38549a9: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:41.036065 12606 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_3578677b7e834b98829f45191b94a17d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:41.036695 13505 tablet_bootstrap.cc:492] T 65a3f8ef595c4beba8a6f53ff0091349 P 0ced0a6dbcf2486183c801a3a84594d0: Bootstrap starting.
I20260812 01:50:41.039515 13505 tablet_bootstrap.cc:654] T 65a3f8ef595c4beba8a6f53ff0091349 P 0ced0a6dbcf2486183c801a3a84594d0: Neither blocks nor log segments found. Creating new log.
@ 0x7f1fe21cbf64 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260812 01:50:41.040473 13504 tablet_bootstrap.cc:492] T 65a3f8ef595c4beba8a6f53ff0091349 P e0adecc3c8034b71923a3a23c38549a9: No bootstrap required, opened a new log
I20260812 01:50:41.040673 13504 ts_tablet_manager.cc:1403] T 65a3f8ef595c4beba8a6f53ff0091349 P e0adecc3c8034b71923a3a23c38549a9: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.000s
I20260812 01:50:41.041756 13504 raft_consensus.cc:359] T 65a3f8ef595c4beba8a6f53ff0091349 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.042006 13504 raft_consensus.cc:385] T 65a3f8ef595c4beba8a6f53ff0091349 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:41.042086 13504 raft_consensus.cc:740] T 65a3f8ef595c4beba8a6f53ff0091349 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0adecc3c8034b71923a3a23c38549a9, State: Initialized, Role: FOLLOWER
I20260812 01:50:41.042376 13504 consensus_queue.cc:260] T 65a3f8ef595c4beba8a6f53ff0091349 P e0adecc3c8034b71923a3a23c38549a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.043000 13504 ts_tablet_manager.cc:1434] T 65a3f8ef595c4beba8a6f53ff0091349 P e0adecc3c8034b71923a3a23c38549a9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260812 01:50:41.043354 13504 tablet_bootstrap.cc:492] T ccd26ea0add54d46a423130dd1bc010f P e0adecc3c8034b71923a3a23c38549a9: Bootstrap starting.
I20260812 01:50:41.044869 13034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd26ea0add54d46a423130dd1bc010f" candidate_uuid: "0ced0a6dbcf2486183c801a3a84594d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" is_pre_election: true
I20260812 01:50:41.045321 13504 tablet_bootstrap.cc:654] T ccd26ea0add54d46a423130dd1bc010f P e0adecc3c8034b71923a3a23c38549a9: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:41.048771 13506 tablet_bootstrap.cc:492] T ccd26ea0add54d46a423130dd1bc010f P 3fa1f2b1b9b548df97a1878bfde765b5: Bootstrap starting.
I20260812 01:50:41.052335 13506 tablet_bootstrap.cc:654] T ccd26ea0add54d46a423130dd1bc010f P 3fa1f2b1b9b548df97a1878bfde765b5: Neither blocks nor log segments found. Creating new log.
W20260812 01:50:41.054533 13290 leader_election.cc:343] T ccd26ea0add54d46a423130dd1bc010f P 0ced0a6dbcf2486183c801a3a84594d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765): Illegal state: must be running to vote when last-logged opid is not known
I20260812 01:50:41.054802 13290 leader_election.cc:304] T ccd26ea0add54d46a423130dd1bc010f P 0ced0a6dbcf2486183c801a3a84594d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ced0a6dbcf2486183c801a3a84594d0; no voters: 3fa1f2b1b9b548df97a1878bfde765b5, e0adecc3c8034b71923a3a23c38549a9
I20260812 01:50:41.055711 12601 catalog_manager.cc:5050] TS 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765): tablet 6663207a3bed43c1a34366d912e789a6 (table default.table_05e4335fa3134a3495c1c0a5f1cd4313 [id=51c4aa84d04240d3939355629be68e6c]) successfully deleted
I20260812 01:50:41.059577 13533 raft_consensus.cc:2749] T ccd26ea0add54d46a423130dd1bc010f P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 01:50:41.063181 13506 tablet_bootstrap.cc:492] T ccd26ea0add54d46a423130dd1bc010f P 3fa1f2b1b9b548df97a1878bfde765b5: No bootstrap required, opened a new log
I20260812 01:50:41.063380 13506 ts_tablet_manager.cc:1403] T ccd26ea0add54d46a423130dd1bc010f P 3fa1f2b1b9b548df97a1878bfde765b5: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.003s
I20260812 01:50:41.064241 13506 raft_consensus.cc:359] T ccd26ea0add54d46a423130dd1bc010f P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.064532 13506 raft_consensus.cc:385] T ccd26ea0add54d46a423130dd1bc010f P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:41.064607 13506 raft_consensus.cc:740] T ccd26ea0add54d46a423130dd1bc010f P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa1f2b1b9b548df97a1878bfde765b5, State: Initialized, Role: FOLLOWER
I20260812 01:50:41.064958 13506 consensus_queue.cc:260] T ccd26ea0add54d46a423130dd1bc010f P 3fa1f2b1b9b548df97a1878bfde765b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.065707 13506 ts_tablet_manager.cc:1434] T ccd26ea0add54d46a423130dd1bc010f P 3fa1f2b1b9b548df97a1878bfde765b5: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 01:50:41.067149 13533 raft_consensus.cc:493] T 78507e1a5eb240038a518f5e279774d6 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:41.067414 13533 raft_consensus.cc:515] T 78507e1a5eb240038a518f5e279774d6 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.068631 13533 leader_election.cc:290] T 78507e1a5eb240038a518f5e279774d6 P 0ced0a6dbcf2486183c801a3a84594d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765), e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853)
I20260812 01:50:41.069607 13200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78507e1a5eb240038a518f5e279774d6" candidate_uuid: "0ced0a6dbcf2486183c801a3a84594d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0adecc3c8034b71923a3a23c38549a9" is_pre_election: true
I20260812 01:50:41.069999 13200 raft_consensus.cc:2468] T 78507e1a5eb240038a518f5e279774d6 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ced0a6dbcf2486183c801a3a84594d0 in term 0.
I20260812 01:50:41.071165 13505 tablet_bootstrap.cc:492] T 65a3f8ef595c4beba8a6f53ff0091349 P 0ced0a6dbcf2486183c801a3a84594d0: No bootstrap required, opened a new log
I20260812 01:50:41.071223 13286 leader_election.cc:304] T 78507e1a5eb240038a518f5e279774d6 P 0ced0a6dbcf2486183c801a3a84594d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ced0a6dbcf2486183c801a3a84594d0, e0adecc3c8034b71923a3a23c38549a9; no voters:
I20260812 01:50:41.071447 13505 ts_tablet_manager.cc:1403] T 65a3f8ef595c4beba8a6f53ff0091349 P 0ced0a6dbcf2486183c801a3a84594d0: Time spent bootstrapping tablet: real 0.035s user 0.009s sys 0.000s
I20260812 01:50:41.071766 13533 raft_consensus.cc:2804] T 78507e1a5eb240038a518f5e279774d6 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:50:41.072562 13533 raft_consensus.cc:493] T 78507e1a5eb240038a518f5e279774d6 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:50:41.072731 13533 raft_consensus.cc:3060] T 78507e1a5eb240038a518f5e279774d6 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:41.073582 13505 raft_consensus.cc:359] T 65a3f8ef595c4beba8a6f53ff0091349 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.074004 13505 raft_consensus.cc:385] T 65a3f8ef595c4beba8a6f53ff0091349 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:41.074241 13505 raft_consensus.cc:740] T 65a3f8ef595c4beba8a6f53ff0091349 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ced0a6dbcf2486183c801a3a84594d0, State: Initialized, Role: FOLLOWER
I20260812 01:50:41.074680 13505 consensus_queue.cc:260] T 65a3f8ef595c4beba8a6f53ff0091349 P 0ced0a6dbcf2486183c801a3a84594d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.083196 13034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78507e1a5eb240038a518f5e279774d6" candidate_uuid: "0ced0a6dbcf2486183c801a3a84594d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" is_pre_election: true
I20260812 01:50:41.083561 13034 raft_consensus.cc:2468] T 78507e1a5eb240038a518f5e279774d6 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ced0a6dbcf2486183c801a3a84594d0 in term 0.
I20260812 01:50:41.081533 13533 raft_consensus.cc:515] T 78507e1a5eb240038a518f5e279774d6 P 0ced0a6dbcf2486183c801a3a84594d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.087522 13533 leader_election.cc:290] T 78507e1a5eb240038a518f5e279774d6 P 0ced0a6dbcf2486183c801a3a84594d0 [CANDIDATE]: Term 1 election: Requested vote from peers 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765), e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853)
I20260812 01:50:41.080960 13505 ts_tablet_manager.cc:1434] T 65a3f8ef595c4beba8a6f53ff0091349 P 0ced0a6dbcf2486183c801a3a84594d0: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20260812 01:50:41.088833 13200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78507e1a5eb240038a518f5e279774d6" candidate_uuid: "0ced0a6dbcf2486183c801a3a84594d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0adecc3c8034b71923a3a23c38549a9"
I20260812 01:50:41.089187 13200 raft_consensus.cc:3060] T 78507e1a5eb240038a518f5e279774d6 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:41.096362 13034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78507e1a5eb240038a518f5e279774d6" candidate_uuid: "0ced0a6dbcf2486183c801a3a84594d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa1f2b1b9b548df97a1878bfde765b5"
I20260812 01:50:41.096698 13034 raft_consensus.cc:3060] T 78507e1a5eb240038a518f5e279774d6 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:41.103863 13525 fs_manager.cc:714] Time spent opening directory manager: real 0.070s user 0.019s sys 0.039s
I20260812 01:50:41.104453 13200 raft_consensus.cc:2468] T 78507e1a5eb240038a518f5e279774d6 P e0adecc3c8034b71923a3a23c38549a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ced0a6dbcf2486183c801a3a84594d0 in term 1.
I20260812 01:50:41.105228 13286 leader_election.cc:304] T 78507e1a5eb240038a518f5e279774d6 P 0ced0a6dbcf2486183c801a3a84594d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ced0a6dbcf2486183c801a3a84594d0, e0adecc3c8034b71923a3a23c38549a9; no voters:
I20260812 01:50:41.105773 13533 raft_consensus.cc:2804] T 78507e1a5eb240038a518f5e279774d6 P 0ced0a6dbcf2486183c801a3a84594d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:50:41.105960 13533 raft_consensus.cc:697] T 78507e1a5eb240038a518f5e279774d6 P 0ced0a6dbcf2486183c801a3a84594d0 [term 1 LEADER]: Becoming Leader. State: Replica: 0ced0a6dbcf2486183c801a3a84594d0, State: Running, Role: LEADER
I20260812 01:50:41.106395 13533 consensus_queue.cc:237] T 78507e1a5eb240038a518f5e279774d6 P 0ced0a6dbcf2486183c801a3a84594d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.112238 13560 raft_consensus.cc:493] T d093fe48bace45f6ba626a54d0ce0e12 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:41.112478 13560 raft_consensus.cc:515] T d093fe48bace45f6ba626a54d0ce0e12 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.113580 13560 leader_election.cc:290] T d093fe48bace45f6ba626a54d0ce0e12 P 3fa1f2b1b9b548df97a1878bfde765b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853), 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:50:41.114671 13369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d093fe48bace45f6ba626a54d0ce0e12" candidate_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ced0a6dbcf2486183c801a3a84594d0" is_pre_election: true
I20260812 01:50:41.114969 13369 raft_consensus.cc:2468] T d093fe48bace45f6ba626a54d0ce0e12 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa1f2b1b9b548df97a1878bfde765b5 in term 0.
I20260812 01:50:41.115566 13609 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:50:41.115742 12952 leader_election.cc:304] T d093fe48bace45f6ba626a54d0ce0e12 P 3fa1f2b1b9b548df97a1878bfde765b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ced0a6dbcf2486183c801a3a84594d0, 3fa1f2b1b9b548df97a1878bfde765b5; no voters:
I20260812 01:50:41.116118 13560 raft_consensus.cc:2804] T d093fe48bace45f6ba626a54d0ce0e12 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:50:41.116340 13560 raft_consensus.cc:493] T d093fe48bace45f6ba626a54d0ce0e12 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:50:41.116474 13560 raft_consensus.cc:3060] T d093fe48bace45f6ba626a54d0ce0e12 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:41.119449 13525 fs_manager.cc:730] Time spent opening block manager: real 0.013s user 0.006s sys 0.004s
I20260812 01:50:41.120227 13560 raft_consensus.cc:515] T d093fe48bace45f6ba626a54d0ce0e12 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.119683 13525 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data,/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/wal
uuid: "a29998df1d9d480691e9c2654ae50c94"
format_stamp: "Formatted at 2026-08-12 01:50:36 on dist-test-slave-9gcw"
I20260812 01:50:41.120954 13525 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:50:41.122509 13201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d093fe48bace45f6ba626a54d0ce0e12" candidate_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0adecc3c8034b71923a3a23c38549a9" is_pre_election: true
I20260812 01:50:41.122874 13201 raft_consensus.cc:2468] T d093fe48bace45f6ba626a54d0ce0e12 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa1f2b1b9b548df97a1878bfde765b5 in term 0.
I20260812 01:50:41.123517 13202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d093fe48bace45f6ba626a54d0ce0e12" candidate_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0adecc3c8034b71923a3a23c38549a9"
I20260812 01:50:41.123715 13202 raft_consensus.cc:3060] T d093fe48bace45f6ba626a54d0ce0e12 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:41.128103 13202 raft_consensus.cc:2468] T d093fe48bace45f6ba626a54d0ce0e12 P e0adecc3c8034b71923a3a23c38549a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa1f2b1b9b548df97a1878bfde765b5 in term 1.
I20260812 01:50:41.130388 13369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d093fe48bace45f6ba626a54d0ce0e12" candidate_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ced0a6dbcf2486183c801a3a84594d0"
I20260812 01:50:41.130666 13369 raft_consensus.cc:3060] T d093fe48bace45f6ba626a54d0ce0e12 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:41.132159 13034 raft_consensus.cc:2468] T 78507e1a5eb240038a518f5e279774d6 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ced0a6dbcf2486183c801a3a84594d0 in term 1.
I20260812 01:50:41.133682 13506 tablet_bootstrap.cc:492] T 65a3f8ef595c4beba8a6f53ff0091349 P 3fa1f2b1b9b548df97a1878bfde765b5: Bootstrap starting.
I20260812 01:50:41.136164 13506 tablet_bootstrap.cc:654] T 65a3f8ef595c4beba8a6f53ff0091349 P 3fa1f2b1b9b548df97a1878bfde765b5: Neither blocks nor log segments found. Creating new log.
I20260812 01:50:41.136690 12952 leader_election.cc:304] T d093fe48bace45f6ba626a54d0ce0e12 P 3fa1f2b1b9b548df97a1878bfde765b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa1f2b1b9b548df97a1878bfde765b5, e0adecc3c8034b71923a3a23c38549a9; no voters:
I20260812 01:50:41.137208 13517 raft_consensus.cc:2804] T d093fe48bace45f6ba626a54d0ce0e12 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:50:41.137550 13517 raft_consensus.cc:697] T d093fe48bace45f6ba626a54d0ce0e12 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 LEADER]: Becoming Leader. State: Replica: 3fa1f2b1b9b548df97a1878bfde765b5, State: Running, Role: LEADER
I20260812 01:50:41.138099 13517 consensus_queue.cc:237] T d093fe48bace45f6ba626a54d0ce0e12 P 3fa1f2b1b9b548df97a1878bfde765b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
@ 0x7f1fe21ca811 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260812 01:50:41.143754 13369 raft_consensus.cc:2468] T d093fe48bace45f6ba626a54d0ce0e12 P 0ced0a6dbcf2486183c801a3a84594d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa1f2b1b9b548df97a1878bfde765b5 in term 1.
I20260812 01:50:41.148850 13560 leader_election.cc:290] T d093fe48bace45f6ba626a54d0ce0e12 P 3fa1f2b1b9b548df97a1878bfde765b5 [CANDIDATE]: Term 1 election: Requested vote from peers e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853), 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:50:41.152364 13506 tablet_bootstrap.cc:492] T 65a3f8ef595c4beba8a6f53ff0091349 P 3fa1f2b1b9b548df97a1878bfde765b5: No bootstrap required, opened a new log
I20260812 01:50:41.152648 13506 ts_tablet_manager.cc:1403] T 65a3f8ef595c4beba8a6f53ff0091349 P 3fa1f2b1b9b548df97a1878bfde765b5: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.004s
I20260812 01:50:41.153919 13506 raft_consensus.cc:359] T 65a3f8ef595c4beba8a6f53ff0091349 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.154208 13506 raft_consensus.cc:385] T 65a3f8ef595c4beba8a6f53ff0091349 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:41.154325 13506 raft_consensus.cc:740] T 65a3f8ef595c4beba8a6f53ff0091349 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa1f2b1b9b548df97a1878bfde765b5, State: Initialized, Role: FOLLOWER
I20260812 01:50:41.154636 13506 consensus_queue.cc:260] T 65a3f8ef595c4beba8a6f53ff0091349 P 3fa1f2b1b9b548df97a1878bfde765b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.155807 13506 ts_tablet_manager.cc:1434] T 65a3f8ef595c4beba8a6f53ff0091349 P 3fa1f2b1b9b548df97a1878bfde765b5: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
@ 0x7f1fe21d248c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260812 01:50:41.161629 13504 tablet_bootstrap.cc:492] T ccd26ea0add54d46a423130dd1bc010f P e0adecc3c8034b71923a3a23c38549a9: No bootstrap required, opened a new log
I20260812 01:50:41.161878 13504 ts_tablet_manager.cc:1403] T ccd26ea0add54d46a423130dd1bc010f P e0adecc3c8034b71923a3a23c38549a9: Time spent bootstrapping tablet: real 0.119s user 0.032s sys 0.063s
I20260812 01:50:41.162806 13504 raft_consensus.cc:359] T ccd26ea0add54d46a423130dd1bc010f P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.162963 13504 raft_consensus.cc:385] T ccd26ea0add54d46a423130dd1bc010f P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 01:50:41.163022 13504 raft_consensus.cc:740] T ccd26ea0add54d46a423130dd1bc010f P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0adecc3c8034b71923a3a23c38549a9, State: Initialized, Role: FOLLOWER
I20260812 01:50:41.163264 13504 consensus_queue.cc:260] T ccd26ea0add54d46a423130dd1bc010f P e0adecc3c8034b71923a3a23c38549a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.163805 13504 ts_tablet_manager.cc:1434] T ccd26ea0add54d46a423130dd1bc010f P e0adecc3c8034b71923a3a23c38549a9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
@ 0x7f1fe21d2309 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaaf86d std::function<>::operator()() at ??:?
@ 0x7f1fce22add9 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f1fd18fa6db start_thread at ??:0
@ 0x7f1fca3b161f clone at ??:0
I20260812 01:50:41.195278 13525 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260812 01:50:41.196298 13525 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:50:41.196658 13525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:50:41.235369 13525 rpc_server.cc:307] RPC server started. Bound to: 127.11.243.60:33215
I20260812 01:50:41.235387 13686 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.243.60:33215 every 8 connection(s)
I20260812 01:50:41.237828 13525 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data/info.pb
I20260812 01:50:41.240111 12236 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskOMow7D/build/asan/bin/kudu as pid 13525
I20260812 01:50:41.247905 13687 sys_catalog.cc:263] Verifying existing consensus state
I20260812 01:50:41.253908 13687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: Bootstrap starting.
I20260812 01:50:41.267649 13687 log.cc:826] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: Log is configured to *not* fsync() on all Append() calls
I20260812 01:50:41.281292 13687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 01:50:41.282444 13687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: Bootstrap complete.
I20260812 01:50:41.293094 13687 raft_consensus.cc:359] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:41.294629 13687 raft_consensus.cc:740] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29998df1d9d480691e9c2654ae50c94, State: Initialized, Role: FOLLOWER
I20260812 01:50:41.295734 13687 consensus_queue.cc:260] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:41.296886 13691 sys_catalog.cc:455] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:41.297246 13691 sys_catalog.cc:458] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:50:41.298839 13687 sys_catalog.cc:565] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:50:41.352640 13708 catalog_manager.cc:1295] Loaded cluster ID: 4d89e47244e04cbeb6aca21d5d476cc2
I20260812 01:50:41.352866 13708 catalog_manager.cc:1588] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: loading cluster ID for follower catalog manager: success
I20260812 01:50:41.358774 13708 catalog_manager.cc:1610] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: acquiring CA information for follower catalog manager: success
I20260812 01:50:41.364835 13708 catalog_manager.cc:1638] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 01:50:41.473060 13560 raft_consensus.cc:493] T 7b799ee2aec842409248e21dfa769a52 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:41.473371 13560 raft_consensus.cc:515] T 7b799ee2aec842409248e21dfa769a52 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.474284 13560 leader_election.cc:290] T 7b799ee2aec842409248e21dfa769a52 P 3fa1f2b1b9b548df97a1878bfde765b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853), 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:50:41.475090 13369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b799ee2aec842409248e21dfa769a52" candidate_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ced0a6dbcf2486183c801a3a84594d0" is_pre_election: true
I20260812 01:50:41.475106 13200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b799ee2aec842409248e21dfa769a52" candidate_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0adecc3c8034b71923a3a23c38549a9" is_pre_election: true
I20260812 01:50:41.475382 13200 raft_consensus.cc:2468] T 7b799ee2aec842409248e21dfa769a52 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa1f2b1b9b548df97a1878bfde765b5 in term 0.
I20260812 01:50:41.475430 13369 raft_consensus.cc:2468] T 7b799ee2aec842409248e21dfa769a52 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa1f2b1b9b548df97a1878bfde765b5 in term 0.
I20260812 01:50:41.476038 12952 leader_election.cc:304] T 7b799ee2aec842409248e21dfa769a52 P 3fa1f2b1b9b548df97a1878bfde765b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa1f2b1b9b548df97a1878bfde765b5, e0adecc3c8034b71923a3a23c38549a9; no voters:
I20260812 01:50:41.476433 13560 raft_consensus.cc:2804] T 7b799ee2aec842409248e21dfa769a52 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:50:41.476564 13560 raft_consensus.cc:493] T 7b799ee2aec842409248e21dfa769a52 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:50:41.476665 13560 raft_consensus.cc:3060] T 7b799ee2aec842409248e21dfa769a52 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:41.480386 13560 raft_consensus.cc:515] T 7b799ee2aec842409248e21dfa769a52 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.481128 13560 leader_election.cc:290] T 7b799ee2aec842409248e21dfa769a52 P 3fa1f2b1b9b548df97a1878bfde765b5 [CANDIDATE]: Term 1 election: Requested vote from peers e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853), 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:50:41.481827 13369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b799ee2aec842409248e21dfa769a52" candidate_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ced0a6dbcf2486183c801a3a84594d0"
I20260812 01:50:41.481850 13200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b799ee2aec842409248e21dfa769a52" candidate_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0adecc3c8034b71923a3a23c38549a9"
I20260812 01:50:41.482048 13200 raft_consensus.cc:3060] T 7b799ee2aec842409248e21dfa769a52 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:41.482090 13369 raft_consensus.cc:3060] T 7b799ee2aec842409248e21dfa769a52 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:41.485500 13369 raft_consensus.cc:2468] T 7b799ee2aec842409248e21dfa769a52 P 0ced0a6dbcf2486183c801a3a84594d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa1f2b1b9b548df97a1878bfde765b5 in term 1.
I20260812 01:50:41.486241 12952 leader_election.cc:304] T 7b799ee2aec842409248e21dfa769a52 P 3fa1f2b1b9b548df97a1878bfde765b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ced0a6dbcf2486183c801a3a84594d0, 3fa1f2b1b9b548df97a1878bfde765b5; no voters:
I20260812 01:50:41.486759 13200 raft_consensus.cc:2468] T 7b799ee2aec842409248e21dfa769a52 P e0adecc3c8034b71923a3a23c38549a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa1f2b1b9b548df97a1878bfde765b5 in term 1.
I20260812 01:50:41.486816 13560 raft_consensus.cc:2804] T 7b799ee2aec842409248e21dfa769a52 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:50:41.487783 13560 raft_consensus.cc:697] T 7b799ee2aec842409248e21dfa769a52 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 LEADER]: Becoming Leader. State: Replica: 3fa1f2b1b9b548df97a1878bfde765b5, State: Running, Role: LEADER
I20260812 01:50:41.488305 13560 consensus_queue.cc:237] T 7b799ee2aec842409248e21dfa769a52 P 3fa1f2b1b9b548df97a1878bfde765b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.500610 13517 consensus_queue.cc:1048] T 230f3a15dade4e7e8dffcc9afcbe61bf P 3fa1f2b1b9b548df97a1878bfde765b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:50:41.507709 13090 heartbeater.cc:344] Connected to a master server at 127.11.243.60:33215
I20260812 01:50:41.514319 13638 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" instance_seqno: 1786499437297311) as {username='slave'} at 127.11.243.1:37493; Asking this server to re-register.
I20260812 01:50:41.516417 13090 heartbeater.cc:461] Registering TS with master...
I20260812 01:50:41.516501 13419 heartbeater.cc:344] Connected to a master server at 127.11.243.60:33215
I20260812 01:50:41.516737 13419 heartbeater.cc:499] Master 127.11.243.60:33215 was elected leader, sending a full tablet report...
I20260812 01:50:41.520020 13637 ts_manager.cc:194] Registered new tserver with Master: 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765)
I20260812 01:50:41.522439 13712 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 164a9e4e737b442f974a0af80ccce066)
I20260812 01:50:41.522665 13712 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:41.525839 13637 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" instance_seqno: 1786499438858305) as {username='slave'} at 127.11.243.3:39961; Asking this server to re-register.
I20260812 01:50:41.526779 13419 heartbeater.cc:461] Registering TS with master...
I20260812 01:50:41.529487 13638 ts_manager.cc:194] Registered new tserver with Master: 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:50:41.534502 13712 leader_election.cc:290] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
W20260812 01:50:41.541867 13434 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.11.243.62:40769)
W20260812 01:50:41.542176 13434 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.11.243.62:40769)
W20260812 01:50:41.543251 13434 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.11.243.62:40769)
W20260812 01:50:41.544351 13434 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.11.243.62:40769)
I20260812 01:50:41.547427 13554 raft_consensus.cc:493] T 65a3f8ef595c4beba8a6f53ff0091349 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:41.547652 13554 raft_consensus.cc:515] T 65a3f8ef595c4beba8a6f53ff0091349 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.548573 13554 leader_election.cc:290] T 65a3f8ef595c4beba8a6f53ff0091349 P e0adecc3c8034b71923a3a23c38549a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765), 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:50:41.550076 13034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a3f8ef595c4beba8a6f53ff0091349" candidate_uuid: "e0adecc3c8034b71923a3a23c38549a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" is_pre_election: true
I20260812 01:50:41.550343 13034 raft_consensus.cc:2468] T 65a3f8ef595c4beba8a6f53ff0091349 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0adecc3c8034b71923a3a23c38549a9 in term 0.
I20260812 01:50:41.550307 13370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a3f8ef595c4beba8a6f53ff0091349" candidate_uuid: "e0adecc3c8034b71923a3a23c38549a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ced0a6dbcf2486183c801a3a84594d0" is_pre_election: true
I20260812 01:50:41.551015 13127 leader_election.cc:304] T 65a3f8ef595c4beba8a6f53ff0091349 P e0adecc3c8034b71923a3a23c38549a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa1f2b1b9b548df97a1878bfde765b5, e0adecc3c8034b71923a3a23c38549a9; no voters:
I20260812 01:50:41.550585 13370 raft_consensus.cc:2468] T 65a3f8ef595c4beba8a6f53ff0091349 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e0adecc3c8034b71923a3a23c38549a9 in term 0.
I20260812 01:50:41.551427 13554 raft_consensus.cc:2804] T 65a3f8ef595c4beba8a6f53ff0091349 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:50:41.551532 13554 raft_consensus.cc:493] T 65a3f8ef595c4beba8a6f53ff0091349 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:50:41.551642 13554 raft_consensus.cc:3060] T 65a3f8ef595c4beba8a6f53ff0091349 P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:41.555040 13554 raft_consensus.cc:515] T 65a3f8ef595c4beba8a6f53ff0091349 P e0adecc3c8034b71923a3a23c38549a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.556313 13034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a3f8ef595c4beba8a6f53ff0091349" candidate_uuid: "e0adecc3c8034b71923a3a23c38549a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa1f2b1b9b548df97a1878bfde765b5"
I20260812 01:50:41.556561 13034 raft_consensus.cc:3060] T 65a3f8ef595c4beba8a6f53ff0091349 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:41.559777 13034 raft_consensus.cc:2468] T 65a3f8ef595c4beba8a6f53ff0091349 P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0adecc3c8034b71923a3a23c38549a9 in term 1.
I20260812 01:50:41.560400 13127 leader_election.cc:304] T 65a3f8ef595c4beba8a6f53ff0091349 P e0adecc3c8034b71923a3a23c38549a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa1f2b1b9b548df97a1878bfde765b5, e0adecc3c8034b71923a3a23c38549a9; no voters:
I20260812 01:50:41.562770 13554 leader_election.cc:290] T 65a3f8ef595c4beba8a6f53ff0091349 P e0adecc3c8034b71923a3a23c38549a9 [CANDIDATE]: Term 1 election: Requested vote from peers 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765), 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:50:41.563184 13554 raft_consensus.cc:2804] T 65a3f8ef595c4beba8a6f53ff0091349 P e0adecc3c8034b71923a3a23c38549a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:50:41.563580 13554 raft_consensus.cc:697] T 65a3f8ef595c4beba8a6f53ff0091349 P e0adecc3c8034b71923a3a23c38549a9 [term 1 LEADER]: Becoming Leader. State: Replica: e0adecc3c8034b71923a3a23c38549a9, State: Running, Role: LEADER
I20260812 01:50:41.564121 13554 consensus_queue.cc:237] T 65a3f8ef595c4beba8a6f53ff0091349 P e0adecc3c8034b71923a3a23c38549a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
W20260812 01:50:41.564826 12684 connection.cc:573] client connection to 127.11.243.62:40769 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 01:50:41.565045 12684 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 5 similar messages]
I20260812 01:50:41.566831 13369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a3f8ef595c4beba8a6f53ff0091349" candidate_uuid: "e0adecc3c8034b71923a3a23c38549a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ced0a6dbcf2486183c801a3a84594d0"
W20260812 01:50:41.566967 13711 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 01:50:41.318815 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.11.243.62:40769 (local address 127.0.0.1:46894)
0812 01:50:41.361941 (+ 43126us) negotiation.cc:107] Waiting for socket to connect
0812 01:50:41.362003 (+ 62us) client_negotiation.cc:175] Beginning negotiation
0812 01:50:41.363223 (+ 1220us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0812 01:50:41.564997 (+201774us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":42799,"thread_start_us":43564,"threads_started":1}
I20260812 01:50:41.567796 13369 raft_consensus.cc:3060] T 65a3f8ef595c4beba8a6f53ff0091349 P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:41.571368 13369 raft_consensus.cc:2468] T 65a3f8ef595c4beba8a6f53ff0091349 P 0ced0a6dbcf2486183c801a3a84594d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e0adecc3c8034b71923a3a23c38549a9 in term 1.
I20260812 01:50:41.568006 13525 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107),
I20260812 01:50:41.576155 13525 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260812 01:50:41.577574 13491 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 01:50:41.561846 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.11.243.62:40769 (local address 127.11.243.3:38847)
0812 01:50:41.562137 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0812 01:50:41.562156 (+ 19us) client_negotiation.cc:175] Beginning negotiation
0812 01:50:41.562303 (+ 147us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0812 01:50:41.576566 (+ 14263us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":162}
W20260812 01:50:41.578850 13486 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 01:50:41.563635 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.11.243.62:40769 (local address 127.11.243.1:34207)
0812 01:50:41.563841 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 01:50:41.563866 (+ 25us) client_negotiation.cc:175] Beginning negotiation
0812 01:50:41.563982 (+ 116us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0812 01:50:41.577940 (+ 13958us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":51}
I20260812 01:50:41.583305 13517 consensus_queue.cc:1048] T 230f3a15dade4e7e8dffcc9afcbe61bf P 3fa1f2b1b9b548df97a1878bfde765b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 01:50:41.595084 13718 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 01:50:41.547472 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.11.243.62:40769 (local address 127.0.0.1:46910)
0812 01:50:41.560772 (+ 13300us) negotiation.cc:107] Waiting for socket to connect
0812 01:50:41.560792 (+ 20us) client_negotiation.cc:175] Beginning negotiation
0812 01:50:41.560931 (+ 139us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0812 01:50:41.594347 (+ 33416us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":13144,"thread_start_us":10969,"threads_started":1}
W20260812 01:50:41.603672 12684 leader_election.cc:336] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
I20260812 01:50:41.606896 13655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7fef830de08489da4a25fb34cfd9737" candidate_term: 3 candidate_status { last_received { term: 2 index: 35 } } ignore_live_leader: false dest_uuid: "a29998df1d9d480691e9c2654ae50c94" is_pre_election: true
I20260812 01:50:41.607591 13253 heartbeater.cc:344] Connected to a master server at 127.11.243.60:33215
I20260812 01:50:41.607811 13655 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fef830de08489da4a25fb34cfd9737 in term 1.
I20260812 01:50:41.609107 12683 leader_election.cc:304] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94, d7fef830de08489da4a25fb34cfd9737; no voters: 164a9e4e737b442f974a0af80ccce066
I20260812 01:50:41.609506 13712 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 01:50:41.609643 13712 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 164a9e4e737b442f974a0af80ccce066)
I20260812 01:50:41.609741 13712 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 2 FOLLOWER]: Advancing to term 3
I20260812 01:50:41.610332 13637 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" instance_seqno: 1786499437993364) as {username='slave'} at 127.11.243.2:42759; Asking this server to re-register.
I20260812 01:50:41.611406 13253 heartbeater.cc:461] Registering TS with master...
I20260812 01:50:41.612883 13712 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:41.613270 13637 ts_manager.cc:194] Registered new tserver with Master: e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853)
I20260812 01:50:41.613744 13712 leader_election.cc:290] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 3 election: Requested vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
I20260812 01:50:41.614444 13655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7fef830de08489da4a25fb34cfd9737" candidate_term: 3 candidate_status { last_received { term: 2 index: 35 } } ignore_live_leader: false dest_uuid: "a29998df1d9d480691e9c2654ae50c94"
I20260812 01:50:41.614668 13655 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 1 FOLLOWER]: Advancing to term 3
W20260812 01:50:41.615515 12684 leader_election.cc:336] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
I20260812 01:50:41.622526 13655 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fef830de08489da4a25fb34cfd9737 in term 3.
I20260812 01:50:41.623281 12683 leader_election.cc:304] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94, d7fef830de08489da4a25fb34cfd9737; no voters: 164a9e4e737b442f974a0af80ccce066
I20260812 01:50:41.623749 13712 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 01:50:41.624285 13712 raft_consensus.cc:697] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 3 LEADER]: Becoming Leader. State: Replica: d7fef830de08489da4a25fb34cfd9737, State: Running, Role: LEADER
I20260812 01:50:41.625001 13712 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 35, Committed index: 35, Last appended: 2.35, Last appended by leader: 35, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:41.626767 13731 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7fef830de08489da4a25fb34cfd9737. Latest consensus state: current_term: 3 leader_uuid: "d7fef830de08489da4a25fb34cfd9737" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:41.627070 13731 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: This master's current role is: LEADER
I20260812 01:50:41.627852 13732 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 01:50:41.632229 13732 catalog_manager.cc:679] Loaded metadata for table default.table_6d36e1d186c948bf87645831e37e7b4d [id=1ea24853d5ae4ae9874c2ee442e9394c]
I20260812 01:50:41.633013 13732 catalog_manager.cc:679] Loaded metadata for table default.table_fce810b18eef421f8cb8d4fffce6a188 [id=38ffa4a422954b5f8a6acb79fbbd95a1]
I20260812 01:50:41.633635 13732 catalog_manager.cc:679] Loaded metadata for table default.table_05e4335fa3134a3495c1c0a5f1cd4313 [id=51c4aa84d04240d3939355629be68e6c]
I20260812 01:50:41.634224 13732 catalog_manager.cc:679] Loaded metadata for table default.table_4827643389f34e8b941a8b303a91aedf [id=53a003cadc7f44339fcad39937ba0ae1]
I20260812 01:50:41.634640 13732 catalog_manager.cc:679] Loaded metadata for table default.table_8f0e075a075f49719ed6cce7b86a8fe8 [id=5bd7338fec7d4410a97da1766eebf362]
I20260812 01:50:41.635113 13732 catalog_manager.cc:679] Loaded metadata for table default.table_9e18b143855f48a1ab04f0fbbb4a7130 [id=5f027eb5cb18441a8b12f882655a1897]
I20260812 01:50:41.635607 13732 catalog_manager.cc:679] Loaded metadata for table default.table_f6e57676e85d4df5b9e688ea19aa48f4 [id=aaf14e2a02484000ae521f9e08c5865e]
I20260812 01:50:41.636091 13732 catalog_manager.cc:679] Loaded metadata for table default.table_d3455b8ae1274ff0ab8eaf05f61734ba [id=c0f9109b45f942d9a4c6282519f618ec]
I20260812 01:50:41.636533 13732 catalog_manager.cc:679] Loaded metadata for table default.table_f04e78d3952146c88cb523c551527e23 [id=f4140461eb024e01ab55c03106c63a3c]
I20260812 01:50:41.639256 13732 tablet_loader.cc:96] loaded metadata for tablet 0872a7468f0241aa8a2a544a5a272abb (table default.table_fce810b18eef421f8cb8d4fffce6a188 [id=38ffa4a422954b5f8a6acb79fbbd95a1])
I20260812 01:50:41.640165 13732 tablet_loader.cc:96] loaded metadata for tablet 22bdb35d65454d60847e4b9747b1a784 (table default.table_f6e57676e85d4df5b9e688ea19aa48f4 [id=aaf14e2a02484000ae521f9e08c5865e])
I20260812 01:50:41.640586 13732 tablet_loader.cc:96] loaded metadata for tablet 230f3a15dade4e7e8dffcc9afcbe61bf (table default.table_9e18b143855f48a1ab04f0fbbb4a7130 [id=5f027eb5cb18441a8b12f882655a1897])
I20260812 01:50:41.640977 13732 tablet_loader.cc:96] loaded metadata for tablet 65a3f8ef595c4beba8a6f53ff0091349 (table default.table_d3455b8ae1274ff0ab8eaf05f61734ba [id=c0f9109b45f942d9a4c6282519f618ec])
I20260812 01:50:41.641677 13732 tablet_loader.cc:96] loaded metadata for tablet 6efaedf1b58840de991c63a645e0dc39 (table default.table_4827643389f34e8b941a8b303a91aedf [id=53a003cadc7f44339fcad39937ba0ae1])
I20260812 01:50:41.642061 13732 tablet_loader.cc:96] loaded metadata for tablet 78507e1a5eb240038a518f5e279774d6 (table default.table_f04e78d3952146c88cb523c551527e23 [id=f4140461eb024e01ab55c03106c63a3c])
I20260812 01:50:41.642454 13732 tablet_loader.cc:96] loaded metadata for tablet 7b799ee2aec842409248e21dfa769a52 (table default.table_8f0e075a075f49719ed6cce7b86a8fe8 [id=5bd7338fec7d4410a97da1766eebf362])
I20260812 01:50:41.643065 13732 tablet_loader.cc:96] loaded metadata for tablet ccd26ea0add54d46a423130dd1bc010f (table default.table_05e4335fa3134a3495c1c0a5f1cd4313 [id=51c4aa84d04240d3939355629be68e6c])
I20260812 01:50:41.643464 13732 tablet_loader.cc:96] loaded metadata for tablet d093fe48bace45f6ba626a54d0ce0e12 (table default.table_6d36e1d186c948bf87645831e37e7b4d [id=1ea24853d5ae4ae9874c2ee442e9394c])
I20260812 01:50:41.643815 13732 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 01:50:41.645123 13732 catalog_manager.cc:1295] Loaded cluster ID: 4d89e47244e04cbeb6aca21d5d476cc2
I20260812 01:50:41.645272 13732 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 01:50:41.646598 13732 catalog_manager.cc:1540] Loading token signing keys...
I20260812 01:50:41.647557 13732 catalog_manager.cc:6103] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: Loaded TSK: 0
I20260812 01:50:41.648492 13732 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 01:50:41.649444 13732 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260812 01:50:41.650669 13732 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: -1
I20260812 01:50:41.655508 12700 master_service.cc:960] ReplaceTablet: received request to replace tablet 0872a7468f0241aa8a2a544a5a272abb from {username='slave'} at 127.0.0.1:57286
I20260812 01:50:41.658769 12699 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57286:
name: "default.Table_f7c1dac58da24fd6af0521dce0509188"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:41.659228 12688 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57286:
table { table_name: "default.Table_6d36e1d186c948bf87645831e37e7b4d" } modify_external_catalogs: true
I20260812 01:50:41.659572 12688 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57286:
table { table_name: "default.Table_6d36e1d186c948bf87645831e37e7b4d" } modify_external_catalogs: true
I20260812 01:50:41.660228 12689 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57286:
name: "default.Table_743419b26708420690c249d0256ab911"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:41.660938 12691 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57286:
table { table_name: "default.Table_d3455b8ae1274ff0ab8eaf05f61734ba" } modify_external_catalogs: true
I20260812 01:50:41.661170 12691 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57286:
table { table_name: "default.Table_d3455b8ae1274ff0ab8eaf05f61734ba" } modify_external_catalogs: true
I20260812 01:50:41.661710 12692 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57286:
name: "default.Table_9b0038bf6d4146199d2c1cd1ec263c7c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:41.662122 12696 master_service.cc:960] ReplaceTablet: received request to replace tablet 7b799ee2aec842409248e21dfa769a52 from {username='slave'} at 127.0.0.1:57286
I20260812 01:50:41.662343 12693 master_service.cc:960] ReplaceTablet: received request to replace tablet 230f3a15dade4e7e8dffcc9afcbe61bf from {username='slave'} at 127.0.0.1:57286
I20260812 01:50:41.663693 12694 master_service.cc:960] ReplaceTablet: received request to replace tablet ccd26ea0add54d46a423130dd1bc010f from {username='slave'} at 127.0.0.1:57286
I20260812 01:50:41.665100 12695 master_service.cc:960] ReplaceTablet: received request to replace tablet 0872a7468f0241aa8a2a544a5a272abb from {username='slave'} at 127.0.0.1:57286
W20260812 01:50:41.666554 12684 consensus_peers.cc:597] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 -> Peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Couldn't send request to peer 164a9e4e737b442f974a0af80ccce066. Status: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 01:50:41.667891 13655 raft_consensus.cc:1275] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Refusing update from remote peer d7fef830de08489da4a25fb34cfd9737: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 37. (index mismatch)
I20260812 01:50:41.668931 13731 consensus_queue.cc:1048] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 36, Last known committed idx: 4, Time since last communication: 0.000s
F20260812 01:50:41.670840 12918 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 1, previous 1; dumping first 2 out of 10 received events: NotificationEvent(eventId=1, eventTime=1786499439, eventType=CREATE_TABLE, dbName=default, tableName=table_05e4335fa3134a3495c1c0a5f1cd4313, message={"server":"","servicePrincipal":"","db":"default","table":"table_05e4335fa3134a3495c1c0a5f1cd4313","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_05e4335fa3134a3495c1c0a5f1cd4313\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786499439},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/warehouse/table_05e4335fa3134a3495c1c0a5f1cd4313\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_05e4335fa3134a3495c1c0a5f1cd4313\",\"kudu.table_id\":\"51c4aa84d04240d3939355629be68e6c\",\"transient_lastDdlTime\":\"1786499439\",\"comment\":\"\",\"kudu.master_addresses\":\"127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"4d89e47244e04cbeb6aca21d5d476cc2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786499439,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=1, eventTime=1786499439, eventType=CREATE_TABLE, dbName=default, tableName=table_6896943d0549474caa2928d9fd085a3a, message={"server":"","servicePrincipal":"","db":"default","table":"table_6896943d0549474caa2928d9fd085a3a","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_6896943d0549474caa2928d9fd085a3a\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786499439},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/warehouse/table_6896943d0549474caa2928d9fd085a3a\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_6896943d0549474caa2928d9fd085a3a\",\"kudu.table_id\":\"93dd830dcb7544e58258e468f73fb54a\",\"transient_lastDdlTime\":\"1786499439\",\"comment\":\"\",\"kudu.master_addresses\":\"127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"4d89e47244e04cbeb6aca21d5d476cc2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786499439,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f162db57d5d google::LogMessage::Fail() at ??:0
@ 0x7f162db5bb23 google::LogMessage::SendToLog() at ??:0
@ 0x7f162db5775c google::LogMessage::Flush() at ??:0
@ 0x7f162db579a1 google::LogMessage::~LogMessage() at ??:0
@ 0x7f1644820f64 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f164481f811 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260812 01:50:41.697616 12659 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:50:41.697938 12659 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
@ 0x7f164482748c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7f1644827309 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaaf86d std::function<>::operator()() at ??:?
@ 0x7f163087fdd9 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f1633f4f6db start_thread at ??:0
@ 0x7f162ca0661f clone at ??:0
I20260812 01:50:41.724697 13691 sys_catalog.cc:455] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7fef830de08489da4a25fb34cfd9737. Latest consensus state: current_term: 3 leader_uuid: "d7fef830de08489da4a25fb34cfd9737" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:41.725026 13691 sys_catalog.cc:458] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:50:41.725492 13744 sys_catalog.cc:455] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "d7fef830de08489da4a25fb34cfd9737" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:41.725782 13744 sys_catalog.cc:458] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:50:41.771541 13737 mvcc.cc:204] Tried to move back new op lower bound from 7317501710234898432 to 7317501703800688640. Current Snapshot: MvccSnapshot[applied={T|T < 7317501710234898432 or (T in {7317501710234898432})}]
I20260812 01:50:41.806985 13554 consensus_queue.cc:1048] T 6efaedf1b58840de991c63a645e0dc39 P e0adecc3c8034b71923a3a23c38549a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:50:41.821614 13763 consensus_queue.cc:1048] T 6efaedf1b58840de991c63a645e0dc39 P e0adecc3c8034b71923a3a23c38549a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:50:41.821858 13560 consensus_queue.cc:1048] T 22bdb35d65454d60847e4b9747b1a784 P 3fa1f2b1b9b548df97a1878bfde765b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:50:41.829716 13560 raft_consensus.cc:493] T ccd26ea0add54d46a423130dd1bc010f P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:41.829947 13560 raft_consensus.cc:515] T ccd26ea0add54d46a423130dd1bc010f P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.830767 13560 leader_election.cc:290] T ccd26ea0add54d46a423130dd1bc010f P 3fa1f2b1b9b548df97a1878bfde765b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853), 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:50:41.831871 13200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd26ea0add54d46a423130dd1bc010f" candidate_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0adecc3c8034b71923a3a23c38549a9" is_pre_election: true
I20260812 01:50:41.832145 13200 raft_consensus.cc:2468] T ccd26ea0add54d46a423130dd1bc010f P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa1f2b1b9b548df97a1878bfde765b5 in term 0.
I20260812 01:50:41.832716 12952 leader_election.cc:304] T ccd26ea0add54d46a423130dd1bc010f P 3fa1f2b1b9b548df97a1878bfde765b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa1f2b1b9b548df97a1878bfde765b5, e0adecc3c8034b71923a3a23c38549a9; no voters:
I20260812 01:50:41.833583 13368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd26ea0add54d46a423130dd1bc010f" candidate_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ced0a6dbcf2486183c801a3a84594d0" is_pre_election: true
I20260812 01:50:41.833772 13560 raft_consensus.cc:2804] T ccd26ea0add54d46a423130dd1bc010f P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 01:50:41.833849 13368 raft_consensus.cc:2468] T ccd26ea0add54d46a423130dd1bc010f P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa1f2b1b9b548df97a1878bfde765b5 in term 0.
I20260812 01:50:41.833905 13560 raft_consensus.cc:493] T ccd26ea0add54d46a423130dd1bc010f P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:50:41.833992 13560 raft_consensus.cc:3060] T ccd26ea0add54d46a423130dd1bc010f P 3fa1f2b1b9b548df97a1878bfde765b5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:41.837589 13560 raft_consensus.cc:515] T ccd26ea0add54d46a423130dd1bc010f P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.838367 13560 leader_election.cc:290] T ccd26ea0add54d46a423130dd1bc010f P 3fa1f2b1b9b548df97a1878bfde765b5 [CANDIDATE]: Term 1 election: Requested vote from peers e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853), 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:50:41.839082 13368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd26ea0add54d46a423130dd1bc010f" candidate_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ced0a6dbcf2486183c801a3a84594d0"
I20260812 01:50:41.839303 13368 raft_consensus.cc:3060] T ccd26ea0add54d46a423130dd1bc010f P 0ced0a6dbcf2486183c801a3a84594d0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:41.841714 13200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd26ea0add54d46a423130dd1bc010f" candidate_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0adecc3c8034b71923a3a23c38549a9"
I20260812 01:50:41.841974 13200 raft_consensus.cc:3060] T ccd26ea0add54d46a423130dd1bc010f P e0adecc3c8034b71923a3a23c38549a9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 01:50:41.842990 13368 raft_consensus.cc:2468] T ccd26ea0add54d46a423130dd1bc010f P 0ced0a6dbcf2486183c801a3a84594d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa1f2b1b9b548df97a1878bfde765b5 in term 1.
I20260812 01:50:41.843873 12952 leader_election.cc:304] T ccd26ea0add54d46a423130dd1bc010f P 3fa1f2b1b9b548df97a1878bfde765b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ced0a6dbcf2486183c801a3a84594d0, 3fa1f2b1b9b548df97a1878bfde765b5; no voters:
I20260812 01:50:41.844475 13560 raft_consensus.cc:2804] T ccd26ea0add54d46a423130dd1bc010f P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 01:50:41.845366 13200 raft_consensus.cc:2468] T ccd26ea0add54d46a423130dd1bc010f P e0adecc3c8034b71923a3a23c38549a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa1f2b1b9b548df97a1878bfde765b5 in term 1.
I20260812 01:50:41.845546 13560 raft_consensus.cc:697] T ccd26ea0add54d46a423130dd1bc010f P 3fa1f2b1b9b548df97a1878bfde765b5 [term 1 LEADER]: Becoming Leader. State: Replica: 3fa1f2b1b9b548df97a1878bfde765b5, State: Running, Role: LEADER
I20260812 01:50:41.847229 13560 consensus_queue.cc:237] T ccd26ea0add54d46a423130dd1bc010f P 3fa1f2b1b9b548df97a1878bfde765b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 } } peers { permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 } } peers { permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 } }
I20260812 01:50:41.857498 13567 consensus_queue.cc:1048] T 22bdb35d65454d60847e4b9747b1a784 P 3fa1f2b1b9b548df97a1878bfde765b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:50:41.864369 13763 consensus_queue.cc:1048] T 0872a7468f0241aa8a2a544a5a272abb P e0adecc3c8034b71923a3a23c38549a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:50:41.886098 13554 consensus_queue.cc:1048] T 0872a7468f0241aa8a2a544a5a272abb P e0adecc3c8034b71923a3a23c38549a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:50:41.988344 13533 consensus_queue.cc:1048] T 78507e1a5eb240038a518f5e279774d6 P 0ced0a6dbcf2486183c801a3a84594d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 01:50:41.989306 13127 connection.cc:573] client connection to 127.11.243.61:40289 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 01:50:41.991088 12954 connection.cc:573] client connection to 127.11.243.61:40289 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 01:50:41.994204 13615 connection.cc:573] server connection from 127.0.0.1:39194 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 01:50:41.996083 13290 connection.cc:573] client connection to 127.11.243.61:40289 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 01:50:41.999676 13533 consensus_queue.cc:1048] T 78507e1a5eb240038a518f5e279774d6 P 0ced0a6dbcf2486183c801a3a84594d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:50:42.068950 13560 consensus_queue.cc:1048] T d093fe48bace45f6ba626a54d0ce0e12 P 3fa1f2b1b9b548df97a1878bfde765b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:50:42.075485 13567 consensus_queue.cc:1048] T d093fe48bace45f6ba626a54d0ce0e12 P 3fa1f2b1b9b548df97a1878bfde765b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:50:42.173794 13744 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7fef830de08489da4a25fb34cfd9737)
I20260812 01:50:42.174029 13744 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:42.176002 13744 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:50:42.177949 13617 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:50:42.179553 13617 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:50:42.179834 13617 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:50:42.179950 13617 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:50:42.180334 13744 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 01:50:42.269546 13560 consensus_queue.cc:1048] T 7b799ee2aec842409248e21dfa769a52 P 3fa1f2b1b9b548df97a1878bfde765b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:50:42.275745 13567 consensus_queue.cc:1048] T 7b799ee2aec842409248e21dfa769a52 P 3fa1f2b1b9b548df97a1878bfde765b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:50:42.509572 13554 consensus_queue.cc:1048] T 65a3f8ef595c4beba8a6f53ff0091349 P e0adecc3c8034b71923a3a23c38549a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" member_type: VOTER last_known_addr { host: "127.11.243.1" port: 42765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:50:42.516368 13554 consensus_queue.cc:1048] T 65a3f8ef595c4beba8a6f53ff0091349 P e0adecc3c8034b71923a3a23c38549a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:50:42.726600 13789 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7fef830de08489da4a25fb34cfd9737)
I20260812 01:50:42.726811 13789 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:42.727531 13789 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:50:42.730473 13617 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:50:42.730767 13617 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:50:42.730923 13617 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:50:42.731242 13789 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 01:50:42.744585 13567 consensus_queue.cc:1048] T ccd26ea0add54d46a423130dd1bc010f P 3fa1f2b1b9b548df97a1878bfde765b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" member_type: VOTER last_known_addr { host: "127.11.243.3" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:50:42.752148 13517 consensus_queue.cc:1048] T ccd26ea0add54d46a423130dd1bc010f P 3fa1f2b1b9b548df97a1878bfde765b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" member_type: VOTER last_known_addr { host: "127.11.243.2" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 01:50:43.751281 13800 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d7fef830de08489da4a25fb34cfd9737)
I20260812 01:50:43.751503 13800 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:43.752259 13800 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:50:43.754889 13617 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:50:43.755162 13617 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:50:43.755282 13617 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:50:43.755601 13800 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 01:50:43.809056 12236 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskOMow7D/build/asan/bin/kudu pid 13525
I20260812 01:50:43.816988 13681 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:50:43.935271 12236 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskOMow7D/build/asan/bin/kudu with pid 13525
I20260812 01:50:44.842291 12236 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskOMow7D/build/asan/bin/kudu
/tmp/dist-test-taskOMow7D/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.243.60:33215
--webserver_interface=127.11.243.60
--webserver_port=45607
--builtin_ntp_servers=127.11.243.20:42563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--hive_metastore_uris=thrift://127.0.0.1:35039
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260812 01:50:45.244520 13827 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:50:45.244850 13827 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:50:45.244921 13827 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 01:50:45.253582 13827 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:50:45.253686 13827 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:50:45.253746 13827 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:50:45.253787 13827 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:50:45.264752 13827 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.243.20:42563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:35039
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.243.60:33215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.243.60
--webserver_port=45607
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 1d9153c248733781bf69132f2d094d9d3c92b2bc
build type FASTDEBUG
built by None at 12 Aug 2026 01:45:57 UTC on bdcb31816ec0
build id 13298
ASAN enabled
I20260812 01:50:45.266561 13827 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:50:45.268620 13827 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 01:50:45.277694 13843 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:50:45.277670 13842 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:50:45.279259 13847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:50:45.280323 13827 server_base.cc:1061] running on GCE node
I20260812 01:50:45.281312 13827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:50:45.283010 13827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:50:45.284291 13827 hybrid_clock.cc:648] HybridClock initialized: now 1786499445284239 us; error 40 us; skew 500 ppm
I20260812 01:50:45.284772 13827 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:50:45.287591 13827 webserver.cc:533] Webserver started at http://127.11.243.60:45607/ using document root <none> and password file <none>
I20260812 01:50:45.288699 13827 fs_manager.cc:362] Metadata directory not provided
I20260812 01:50:45.288857 13827 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:50:45.295588 13827 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 01:50:45.298833 13856 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:50:45.300257 13827 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260812 01:50:45.300457 13827 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data,/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/wal
uuid: "a29998df1d9d480691e9c2654ae50c94"
format_stamp: "Formatted at 2026-08-12 01:50:36 on dist-test-slave-9gcw"
I20260812 01:50:45.301302 13827 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:50:45.331287 13827 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260812 01:50:45.332338 13827 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:50:45.332680 13827 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:50:45.355167 13827 rpc_server.cc:307] RPC server started. Bound to: 127.11.243.60:33215
I20260812 01:50:45.355192 13916 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.243.60:33215 every 8 connection(s)
I20260812 01:50:45.357048 13827 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data/info.pb
I20260812 01:50:45.358103 12236 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskOMow7D/build/asan/bin/kudu as pid 13827
I20260812 01:50:45.365865 13917 sys_catalog.cc:263] Verifying existing consensus state
I20260812 01:50:45.371295 13917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: Bootstrap starting.
I20260812 01:50:45.383373 13917 log.cc:826] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: Log is configured to *not* fsync() on all Append() calls
I20260812 01:50:45.411353 13917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: Bootstrap replayed 1/1 log segments. Stats: ops{read=40 overwritten=0 applied=35 ignored=0} inserts{seen=24 ignored=0} mutations{seen=22 ignored=0} orphaned_commits=0. Pending: 5 replicates
I20260812 01:50:45.412112 13917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: Bootstrap complete.
I20260812 01:50:45.417816 13917 raft_consensus.cc:359] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Replica starting. Triggering 5 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:45.421288 13917 raft_consensus.cc:740] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29998df1d9d480691e9c2654ae50c94, State: Initialized, Role: FOLLOWER
I20260812 01:50:45.422142 13917 consensus_queue.cc:260] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 35, Last appended: 3.40, Last appended by leader: 40, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:45.423270 13925 sys_catalog.cc:455] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:45.423580 13925 sys_catalog.cc:458] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:50:45.424525 13917 sys_catalog.cc:565] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:50:45.438318 13945 catalog_manager.cc:1295] Loaded cluster ID: 4d89e47244e04cbeb6aca21d5d476cc2
I20260812 01:50:45.438544 13945 catalog_manager.cc:1588] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: loading cluster ID for follower catalog manager: success
I20260812 01:50:45.444105 13945 catalog_manager.cc:1610] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: acquiring CA information for follower catalog manager: success
I20260812 01:50:45.447249 13945 catalog_manager.cc:1638] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 01:50:45.441418 13827 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:50:45.447865 13827 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:50:45.472522 13253 heartbeater.cc:344] Connected to a master server at 127.11.243.60:33215
I20260812 01:50:45.475623 13875 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" instance_seqno: 1786499437993364) as {username='slave'} at 127.11.243.2:45003; Asking this server to re-register.
I20260812 01:50:45.476495 13253 heartbeater.cc:461] Registering TS with master...
I20260812 01:50:45.478849 13875 ts_manager.cc:194] Registered new tserver with Master: e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853)
I20260812 01:50:45.568778 13090 heartbeater.cc:344] Connected to a master server at 127.11.243.60:33215
I20260812 01:50:45.570314 13875 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" instance_seqno: 1786499437297311) as {username='slave'} at 127.11.243.1:49423; Asking this server to re-register.
I20260812 01:50:45.570963 13090 heartbeater.cc:461] Registering TS with master...
I20260812 01:50:45.572399 13875 ts_manager.cc:194] Registered new tserver with Master: 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765)
I20260812 01:50:45.654503 13419 heartbeater.cc:344] Connected to a master server at 127.11.243.60:33215
I20260812 01:50:45.656594 13875 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" instance_seqno: 1786499438858305) as {username='slave'} at 127.11.243.3:33795; Asking this server to re-register.
I20260812 01:50:45.657362 13419 heartbeater.cc:461] Registering TS with master...
I20260812 01:50:45.658797 13875 ts_manager.cc:194] Registered new tserver with Master: 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:50:45.921608 13925 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:45.921868 13925 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:45.924283 13925 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:50:45.925132 13860 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:50:45.926692 13860 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:50:45.926899 13860 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:50:45.926983 13860 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:50:45.927335 13925 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 01:50:46.440006 13962 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:46.440212 13962 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:46.441238 13962 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:50:46.443885 13860 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:50:46.444090 13860 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:50:46.444195 13860 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:50:46.444521 13962 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 01:50:47.416275 13976 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:47.416461 13976 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:47.417099 13976 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:50:47.419808 13860 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:50:47.420064 13860 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:50:47.420190 13860 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:50:47.420617 13976 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 01:50:48.467599 12236 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskOMow7D/build/asan/bin/kudu
/tmp/dist-test-taskOMow7D/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.243.62:40769
--webserver_interface=127.11.243.62
--webserver_port=41749
--builtin_ntp_servers=127.11.243.20:42563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--hive_metastore_uris=thrift://127.0.0.1:35039
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260812 01:50:48.555843 13995 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:48.556106 13995 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:48.556919 13995 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:50:48.566396 13860 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:50:48.566650 13860 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:50:48.566811 13860 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:50:48.567092 13995 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260812 01:50:48.847030 13994 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:50:48.847447 13994 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:50:48.847585 13994 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 01:50:48.856357 13994 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:50:48.856504 13994 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:50:48.856629 13994 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:50:48.856719 13994 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:50:48.867532 13994 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.243.20:42563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:35039
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.243.62:40769
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.243.62
--webserver_port=41749
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 1d9153c248733781bf69132f2d094d9d3c92b2bc
build type FASTDEBUG
built by None at 12 Aug 2026 01:45:57 UTC on bdcb31816ec0
build id 13298
ASAN enabled
I20260812 01:50:48.869432 13994 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:50:48.871335 13994 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 01:50:48.880699 14007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:50:48.881116 14008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:50:48.881740 14010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:50:48.881908 13994 server_base.cc:1061] running on GCE node
I20260812 01:50:48.882834 13994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:50:48.884647 13994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:50:48.885888 13994 hybrid_clock.cc:648] HybridClock initialized: now 1786499448885818 us; error 67 us; skew 500 ppm
I20260812 01:50:48.886360 13994 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:50:48.889284 13994 webserver.cc:533] Webserver started at http://127.11.243.62:41749/ using document root <none> and password file <none>
I20260812 01:50:48.890259 13994 fs_manager.cc:362] Metadata directory not provided
I20260812 01:50:48.890450 13994 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:50:48.897488 13994 fs_manager.cc:714] Time spent opening directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 01:50:48.900930 14017 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:50:48.902642 13994 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:50:48.902904 13994 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/data,/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/wal
uuid: "164a9e4e737b442f974a0af80ccce066"
format_stamp: "Formatted at 2026-08-12 01:50:35 on dist-test-slave-9gcw"
I20260812 01:50:48.903760 13994 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:50:48.954569 13994 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260812 01:50:48.955689 13994 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:50:48.956010 13994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:50:48.982100 13994 rpc_server.cc:307] RPC server started. Bound to: 127.11.243.62:40769
I20260812 01:50:48.982115 14075 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.243.62:40769 every 8 connection(s)
I20260812 01:50:48.984193 13994 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-0/data/info.pb
I20260812 01:50:48.991753 14076 sys_catalog.cc:263] Verifying existing consensus state
I20260812 01:50:48.993309 12236 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskOMow7D/build/asan/bin/kudu as pid 13994
I20260812 01:50:48.997385 14076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066: Bootstrap starting.
I20260812 01:50:49.012710 14076 log.cc:826] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066: Log is configured to *not* fsync() on all Append() calls
I20260812 01:50:49.045580 14076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066: Bootstrap replayed 1/1 log segments. Stats: ops{read=35 overwritten=0 applied=35 ignored=0} inserts{seen=24 ignored=0} mutations{seen=22 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 01:50:49.046250 14076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066: Bootstrap complete.
I20260812 01:50:49.052073 14076 raft_consensus.cc:359] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:49.052873 14076 raft_consensus.cc:740] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164a9e4e737b442f974a0af80ccce066, State: Initialized, Role: FOLLOWER
I20260812 01:50:49.053571 14076 consensus_queue.cc:260] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 35, Last appended: 2.35, Last appended by leader: 35, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:49.054438 14081 sys_catalog.cc:455] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:49.054720 14081 sys_catalog.cc:458] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:50:49.055572 14076 sys_catalog.cc:565] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:50:49.068877 14097 catalog_manager.cc:1295] Loaded cluster ID: 4d89e47244e04cbeb6aca21d5d476cc2
I20260812 01:50:49.069165 14097 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066: loading cluster ID for follower catalog manager: success
I20260812 01:50:49.075204 14097 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066: acquiring CA information for follower catalog manager: success
I20260812 01:50:49.087531 14097 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 01:50:49.098397 13994 master_runner.cc:187] Error getting master registration for 127.11.243.61:40289: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111),
I20260812 01:50:49.102818 13994 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:50:49.109813 13092 heartbeater.cc:344] Connected to a master server at 127.11.243.62:40769
I20260812 01:50:49.114605 14034 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" instance_seqno: 1786499437297311) as {username='slave'} at 127.11.243.1:36719; Asking this server to re-register.
I20260812 01:50:49.115597 13092 heartbeater.cc:461] Registering TS with master...
I20260812 01:50:49.117868 14034 ts_manager.cc:194] Registered new tserver with Master: 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765)
I20260812 01:50:49.171119 13421 heartbeater.cc:344] Connected to a master server at 127.11.243.62:40769
I20260812 01:50:49.173454 14034 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" instance_seqno: 1786499438858305) as {username='slave'} at 127.11.243.3:52087; Asking this server to re-register.
I20260812 01:50:49.174336 13421 heartbeater.cc:461] Registering TS with master...
I20260812 01:50:49.176364 14034 ts_manager.cc:194] Registered new tserver with Master: 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:50:49.444591 13254 heartbeater.cc:344] Connected to a master server at 127.11.243.62:40769
I20260812 01:50:49.446877 14034 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" instance_seqno: 1786499437993364) as {username='slave'} at 127.11.243.2:58495; Asking this server to re-register.
I20260812 01:50:49.447602 13254 heartbeater.cc:461] Registering TS with master...
I20260812 01:50:49.448967 14034 ts_manager.cc:194] Registered new tserver with Master: e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853)
I20260812 01:50:49.543138 14081 raft_consensus.cc:493] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:49.543520 14081 raft_consensus.cc:515] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:49.545993 14081 leader_election.cc:290] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
W20260812 01:50:49.546747 14021 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
W20260812 01:50:49.549048 14021 leader_election.cc:336] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:50:49.554329 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "164a9e4e737b442f974a0af80ccce066" candidate_term: 3 candidate_status { last_received { term: 2 index: 35 } } ignore_live_leader: false dest_uuid: "a29998df1d9d480691e9c2654ae50c94" is_pre_election: true
I20260812 01:50:49.554867 13885 raft_consensus.cc:2393] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164a9e4e737b442f974a0af80ccce066 in current term 3: Already voted for candidate d7fef830de08489da4a25fb34cfd9737 in this term.
I20260812 01:50:49.555688 14020 leader_election.cc:304] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164a9e4e737b442f974a0af80ccce066; no voters: a29998df1d9d480691e9c2654ae50c94, d7fef830de08489da4a25fb34cfd9737
I20260812 01:50:49.556171 14081 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 2 FOLLOWER]: Advancing to term 3
I20260812 01:50:49.560269 14081 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 01:50:50.131290 14118 raft_consensus.cc:493] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:50.131484 14118 raft_consensus.cc:515] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:50.132447 14118 leader_election.cc:290] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
I20260812 01:50:50.133266 13885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "164a9e4e737b442f974a0af80ccce066" candidate_term: 4 candidate_status { last_received { term: 2 index: 35 } } ignore_live_leader: false dest_uuid: "a29998df1d9d480691e9c2654ae50c94" is_pre_election: true
I20260812 01:50:50.133697 13885 raft_consensus.cc:2410] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 164a9e4e737b442f974a0af80ccce066 for term 4 because replica has last-logged OpId of term: 3 index: 40, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 35.
W20260812 01:50:50.134904 14021 leader_election.cc:336] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:50:50.135061 14021 leader_election.cc:304] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164a9e4e737b442f974a0af80ccce066; no voters: a29998df1d9d480691e9c2654ae50c94, d7fef830de08489da4a25fb34cfd9737
I20260812 01:50:50.135335 14118 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 01:50:50.460987 13827 master_runner.cc:187] Error getting master registration for 127.11.243.61:40289: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111),
I20260812 01:50:50.461295 13827 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:50:50.579281 14126 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:50.579491 14126 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:50.580442 14126 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
I20260812 01:50:50.581383 14046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a29998df1d9d480691e9c2654ae50c94" candidate_term: 4 candidate_status { last_received { term: 3 index: 40 } } ignore_live_leader: false dest_uuid: "164a9e4e737b442f974a0af80ccce066" is_pre_election: true
I20260812 01:50:50.581951 14046 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29998df1d9d480691e9c2654ae50c94 in term 3.
I20260812 01:50:50.582605 13860 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164a9e4e737b442f974a0af80ccce066, a29998df1d9d480691e9c2654ae50c94; no voters:
I20260812 01:50:50.583005 14126 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 01:50:50.583184 14126 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:50:50.583328 14126 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 3 FOLLOWER]: Advancing to term 4
W20260812 01:50:50.583585 13860 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:50:50.587208 14126 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:50.587870 14126 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 election: Requested vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
I20260812 01:50:50.588560 14046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a29998df1d9d480691e9c2654ae50c94" candidate_term: 4 candidate_status { last_received { term: 3 index: 40 } } ignore_live_leader: false dest_uuid: "164a9e4e737b442f974a0af80ccce066"
I20260812 01:50:50.588804 14046 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 3 FOLLOWER]: Advancing to term 4
W20260812 01:50:50.590127 13860 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:50:50.591394 14046 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29998df1d9d480691e9c2654ae50c94 in term 4.
I20260812 01:50:50.592001 13860 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164a9e4e737b442f974a0af80ccce066, a29998df1d9d480691e9c2654ae50c94; no voters: d7fef830de08489da4a25fb34cfd9737
I20260812 01:50:50.592404 14126 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 01:50:50.593056 14126 raft_consensus.cc:697] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 4 LEADER]: Becoming Leader. State: Replica: a29998df1d9d480691e9c2654ae50c94, State: Running, Role: LEADER
I20260812 01:50:50.593812 14126 consensus_queue.cc:237] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 35, Committed index: 35, Last appended: 3.40, Last appended by leader: 40, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:50.597239 14128 sys_catalog.cc:455] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a29998df1d9d480691e9c2654ae50c94. Latest consensus state: current_term: 4 leader_uuid: "a29998df1d9d480691e9c2654ae50c94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:50.597568 14128 sys_catalog.cc:458] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: This master's current role is: LEADER
I20260812 01:50:51.086275 14046 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 4 FOLLOWER]: Refusing update from remote peer a29998df1d9d480691e9c2654ae50c94: Log matching property violated. Preceding OpId in replica: term: 2 index: 35. Preceding OpId from leader: term: 4 index: 41. (index mismatch)
I20260812 01:50:51.087519 14128 consensus_queue.cc:1048] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 41, Last known committed idx: 35, Time since last communication: 0.000s
I20260812 01:50:51.095386 14134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a29998df1d9d480691e9c2654ae50c94. Latest consensus state: current_term: 4 leader_uuid: "a29998df1d9d480691e9c2654ae50c94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:51.095813 14134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:50:51.102079 14128 sys_catalog.cc:455] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "a29998df1d9d480691e9c2654ae50c94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:51.102370 14128 sys_catalog.cc:458] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: This master's current role is: LEADER
I20260812 01:50:51.102617 14128 sys_catalog.cc:455] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "a29998df1d9d480691e9c2654ae50c94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:51.102831 14128 sys_catalog.cc:458] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: This master's current role is: LEADER
W20260812 01:50:51.113644 13860 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111) [suppressed 9 similar messages]
I20260812 01:50:51.115083 14134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "a29998df1d9d480691e9c2654ae50c94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:51.115423 14134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:50:51.116703 14150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "a29998df1d9d480691e9c2654ae50c94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:51.117270 14150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:50:51.118089 14130 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
W20260812 01:50:51.119514 13860 consensus_peers.cc:597] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 -> Peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Couldn't send request to peer d7fef830de08489da4a25fb34cfd9737. Status: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 01:50:51.121253 14130 catalog_manager.cc:679] Loaded metadata for table default.table_6d36e1d186c948bf87645831e37e7b4d [id=1ea24853d5ae4ae9874c2ee442e9394c]
I20260812 01:50:51.121744 14130 catalog_manager.cc:679] Loaded metadata for table default.table_fce810b18eef421f8cb8d4fffce6a188 [id=38ffa4a422954b5f8a6acb79fbbd95a1]
I20260812 01:50:51.122153 14130 catalog_manager.cc:679] Loaded metadata for table default.table_05e4335fa3134a3495c1c0a5f1cd4313 [id=51c4aa84d04240d3939355629be68e6c]
I20260812 01:50:51.122524 14130 catalog_manager.cc:679] Loaded metadata for table default.table_4827643389f34e8b941a8b303a91aedf [id=53a003cadc7f44339fcad39937ba0ae1]
I20260812 01:50:51.122888 14130 catalog_manager.cc:679] Loaded metadata for table default.table_8f0e075a075f49719ed6cce7b86a8fe8 [id=5bd7338fec7d4410a97da1766eebf362]
I20260812 01:50:51.123278 14130 catalog_manager.cc:679] Loaded metadata for table default.table_9e18b143855f48a1ab04f0fbbb4a7130 [id=5f027eb5cb18441a8b12f882655a1897]
I20260812 01:50:51.123760 14130 catalog_manager.cc:679] Loaded metadata for table default.table_f6e57676e85d4df5b9e688ea19aa48f4 [id=aaf14e2a02484000ae521f9e08c5865e]
I20260812 01:50:51.124184 14130 catalog_manager.cc:679] Loaded metadata for table default.table_d3455b8ae1274ff0ab8eaf05f61734ba [id=c0f9109b45f942d9a4c6282519f618ec]
I20260812 01:50:51.124631 14130 catalog_manager.cc:679] Loaded metadata for table default.table_f04e78d3952146c88cb523c551527e23 [id=f4140461eb024e01ab55c03106c63a3c]
I20260812 01:50:51.127662 14130 tablet_loader.cc:96] loaded metadata for tablet 22bdb35d65454d60847e4b9747b1a784 (table default.table_f6e57676e85d4df5b9e688ea19aa48f4 [id=aaf14e2a02484000ae521f9e08c5865e])
I20260812 01:50:51.128443 14130 tablet_loader.cc:96] loaded metadata for tablet 65a3f8ef595c4beba8a6f53ff0091349 (table default.table_d3455b8ae1274ff0ab8eaf05f61734ba [id=c0f9109b45f942d9a4c6282519f618ec])
I20260812 01:50:51.129186 14130 tablet_loader.cc:96] loaded metadata for tablet 6efaedf1b58840de991c63a645e0dc39 (table default.table_4827643389f34e8b941a8b303a91aedf [id=53a003cadc7f44339fcad39937ba0ae1])
I20260812 01:50:51.129622 14130 tablet_loader.cc:96] loaded metadata for tablet 78507e1a5eb240038a518f5e279774d6 (table default.table_f04e78d3952146c88cb523c551527e23 [id=f4140461eb024e01ab55c03106c63a3c])
I20260812 01:50:51.130240 14130 tablet_loader.cc:96] loaded metadata for tablet 8dc5fa33710b4bfa8421def7e4ff95f5 (table default.table_8f0e075a075f49719ed6cce7b86a8fe8 [id=5bd7338fec7d4410a97da1766eebf362])
I20260812 01:50:51.130556 14130 tablet_loader.cc:96] loaded metadata for tablet 984deca5cd434f4aaa770d64f8547fae (table default.table_fce810b18eef421f8cb8d4fffce6a188 [id=38ffa4a422954b5f8a6acb79fbbd95a1])
I20260812 01:50:51.131157 14130 tablet_loader.cc:96] loaded metadata for tablet c80bf9cfe58e4f62a7847d09e3260c48 (table default.table_9e18b143855f48a1ab04f0fbbb4a7130 [id=5f027eb5cb18441a8b12f882655a1897])
I20260812 01:50:51.131765 14130 tablet_loader.cc:96] loaded metadata for tablet d035719e90ad4710b0e391251cc8ae83 (table default.table_05e4335fa3134a3495c1c0a5f1cd4313 [id=51c4aa84d04240d3939355629be68e6c])
I20260812 01:50:51.132169 14130 tablet_loader.cc:96] loaded metadata for tablet d093fe48bace45f6ba626a54d0ce0e12 (table default.table_6d36e1d186c948bf87645831e37e7b4d [id=1ea24853d5ae4ae9874c2ee442e9394c])
I20260812 01:50:51.132477 14130 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 01:50:51.133699 14130 catalog_manager.cc:1295] Loaded cluster ID: 4d89e47244e04cbeb6aca21d5d476cc2
I20260812 01:50:51.133775 14130 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 01:50:51.134982 14130 catalog_manager.cc:1540] Loading token signing keys...
I20260812 01:50:51.136070 14130 catalog_manager.cc:6103] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: Loaded TSK: 0
I20260812 01:50:51.137126 14130 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 01:50:51.138079 14130 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260812 01:50:51.138929 14130 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: -1
I20260812 01:50:51.273959 13875 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:32846:
table { table_name: "default.Table_4827643389f34e8b941a8b303a91aedf" } new_table_name: "default.Table_a9ac4ab0283e4af38523d6ba191bf686" modify_external_catalogs: true
I20260812 01:50:51.273825 13874 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:32846:
table { table_name: "default.Table_05e4335fa3134a3495c1c0a5f1cd4313" } new_table_name: "default.Table_4beba14d89f84ed5b3f67d5f527c4434" modify_external_catalogs: true
I20260812 01:50:51.275287 13871 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32846:
name: "default.Table_65f203f5b94f4efb9d107338b6e02963"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:51.275998 13869 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:32846:
table { table_name: "default.Table_9e18b143855f48a1ab04f0fbbb4a7130" } new_table_name: "default.Table_057e8e16d3e54245b3a2986507ebe8b4" modify_external_catalogs: true
I20260812 01:50:51.276321 13867 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32846:
name: "default.Table_7bd2016211964bd680b0484ef89b4b4d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:51.275514 13873 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32846:
name: "default.Table_1136408fd2f648dcbf9d582bb5764e10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:51.277908 13868 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:32846:
table { table_name: "default.Table_f04e78d3952146c88cb523c551527e23" } new_table_name: "default.Table_4b1538154ea5463f90b1549ebc72d0f7" modify_external_catalogs: true
I20260812 01:50:51.279896 13865 master_service.cc:960] ReplaceTablet: received request to replace tablet ccd26ea0add54d46a423130dd1bc010f from {username='slave'} at 127.0.0.1:32846
I20260812 01:50:51.275568 13872 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32846:
name: "default.Table_928e3ae44e3245f3a62ae1724ccd100a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:51.279992 13866 master_service.cc:960] ReplaceTablet: received request to replace tablet 230f3a15dade4e7e8dffcc9afcbe61bf from {username='slave'} at 127.0.0.1:32846
I20260812 01:50:51.286921 13865 master_service.cc:960] ReplaceTablet: received request to replace tablet 0872a7468f0241aa8a2a544a5a272abb from {username='slave'} at 127.0.0.1:32846
I20260812 01:50:51.287626 13865 master_service.cc:960] ReplaceTablet: received request to replace tablet 7b799ee2aec842409248e21dfa769a52 from {username='slave'} at 127.0.0.1:32846
I20260812 01:50:51.288607 13865 master_service.cc:960] ReplaceTablet: received request to replace tablet 0872a7468f0241aa8a2a544a5a272abb from {username='slave'} at 127.0.0.1:32846
I20260812 01:50:51.288455 13866 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32846:
name: "default.Table_f7c1dac58da24fd6af0521dce0509188"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
F20260812 01:50:51.289111 13943 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 1, previous 1; dumping first 2 out of 10 received events: NotificationEvent(eventId=1, eventTime=1786499439, eventType=CREATE_TABLE, dbName=default, tableName=table_05e4335fa3134a3495c1c0a5f1cd4313, message={"server":"","servicePrincipal":"","db":"default","table":"table_05e4335fa3134a3495c1c0a5f1cd4313","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_05e4335fa3134a3495c1c0a5f1cd4313\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786499439},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/warehouse/table_05e4335fa3134a3495c1c0a5f1cd4313\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_05e4335fa3134a3495c1c0a5f1cd4313\",\"kudu.table_id\":\"51c4aa84d04240d3939355629be68e6c\",\"transient_lastDdlTime\":\"1786499439\",\"comment\":\"\",\"kudu.master_addresses\":\"127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"4d89e47244e04cbeb6aca21d5d476cc2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786499439,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=1, eventTime=1786499439, eventType=CREATE_TABLE, dbName=default, tableName=table_6896943d0549474caa2928d9fd085a3a, message={"server":"","servicePrincipal":"","db":"default","table":"table_6896943d0549474caa2928d9fd085a3a","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_6896943d0549474caa2928d9fd085a3a\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786499439},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/warehouse/table_6896943d0549474caa2928d9fd085a3a\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_6896943d0549474caa2928d9fd085a3a\",\"kudu.table_id\":\"93dd830dcb7544e58258e468f73fb54a\",\"transient_lastDdlTime\":\"1786499439\",\"comment\":\"\",\"kudu.master_addresses\":\"127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"4d89e47244e04cbeb6aca21d5d476cc2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786499439,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20260812 01:50:51.289531 13865 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32846:
name: "default.Table_9b0038bf6d4146199d2c1cd1ec263c7c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
@ 0x7fc272b0ad5d google::LogMessage::Fail() at ??:0
@ 0x7fc272b0eb23 google::LogMessage::SendToLog() at ??:0
@ 0x7fc272b0a75c google::LogMessage::Flush() at ??:0
@ 0x7fc272b0a9a1 google::LogMessage::~LogMessage() at ??:0
@ 0x7fc2897d3f64 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7fc2897d2811 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7fc2897da48c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7fc2897da309 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaaf86d std::function<>::operator()() at ??:?
@ 0x7fc275832dd9 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fc278f026db start_thread at ??:0
@ 0x7fc2719b961f clone at ??:0
W20260812 01:50:51.514564 13126 connection.cc:573] client connection to 127.11.243.60:33215 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 01:50:51.514600 13433 connection.cc:573] client connection to 127.11.243.60:33215 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 01:50:51.515412 13433 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.11.243.60:33215)
W20260812 01:50:51.516042 13433 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.11.243.60:33215)
W20260812 01:50:51.516269 13433 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.11.243.60:33215)
W20260812 01:50:51.516469 13433 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.11.243.60:33215)
I20260812 01:50:51.598004 14150 raft_consensus.cc:493] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29998df1d9d480691e9c2654ae50c94)
I20260812 01:50:51.598189 14150 raft_consensus.cc:515] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:51.598989 14150 leader_election.cc:290] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
W20260812 01:50:51.601765 14020 leader_election.cc:336] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215): Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
W20260812 01:50:51.602135 14021 leader_election.cc:336] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:50:51.602290 14021 leader_election.cc:304] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164a9e4e737b442f974a0af80ccce066; no voters: a29998df1d9d480691e9c2654ae50c94, d7fef830de08489da4a25fb34cfd9737
I20260812 01:50:51.602597 14150 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 01:50:51.689426 13419 heartbeater.cc:499] Master 127.11.243.60:33215 was elected leader, sending a full tablet report...
I20260812 01:50:52.158527 14178 raft_consensus.cc:493] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29998df1d9d480691e9c2654ae50c94)
I20260812 01:50:52.158735 14178 raft_consensus.cc:515] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:52.159663 14178 leader_election.cc:290] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
W20260812 01:50:52.162068 14021 leader_election.cc:336] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
W20260812 01:50:52.162278 14020 leader_election.cc:336] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215): Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
I20260812 01:50:52.162418 14020 leader_election.cc:304] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164a9e4e737b442f974a0af80ccce066; no voters: a29998df1d9d480691e9c2654ae50c94, d7fef830de08489da4a25fb34cfd9737
I20260812 01:50:52.162849 14178 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 01:50:52.225394 12236 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskOMow7D/build/asan/bin/kudu
/tmp/dist-test-taskOMow7D/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.243.61:40289
--webserver_interface=127.11.243.61
--webserver_port=46117
--builtin_ntp_servers=127.11.243.20:42563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--hive_metastore_uris=thrift://127.0.0.1:35039
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260812 01:50:52.598390 14185 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:50:52.598811 14185 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:50:52.598948 14185 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 01:50:52.608855 14185 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:50:52.608984 14185 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:50:52.609081 14185 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:50:52.609184 14185 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:50:52.620048 14185 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.243.20:42563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:35039
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.243.61:40289
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.243.61
--webserver_port=46117
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 1d9153c248733781bf69132f2d094d9d3c92b2bc
build type FASTDEBUG
built by None at 12 Aug 2026 01:45:57 UTC on bdcb31816ec0
build id 13298
ASAN enabled
I20260812 01:50:52.622025 14185 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:50:52.624195 14185 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 01:50:52.633653 14190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:50:52.633733 14191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:50:52.634406 14194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:50:52.635380 14185 server_base.cc:1061] running on GCE node
I20260812 01:50:52.636320 14185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:50:52.638366 14185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:50:52.639875 14185 hybrid_clock.cc:648] HybridClock initialized: now 1786499452639812 us; error 64 us; skew 500 ppm
I20260812 01:50:52.640363 14185 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:50:52.643059 14185 webserver.cc:533] Webserver started at http://127.11.243.61:46117/ using document root <none> and password file <none>
I20260812 01:50:52.643826 14185 fs_manager.cc:362] Metadata directory not provided
I20260812 01:50:52.643944 14185 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:50:52.649991 14185 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 01:50:52.653657 14202 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:50:52.655336 14185 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.002s
I20260812 01:50:52.655514 14185 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data,/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/wal
uuid: "d7fef830de08489da4a25fb34cfd9737"
format_stamp: "Formatted at 2026-08-12 01:50:35 on dist-test-slave-9gcw"
I20260812 01:50:52.656283 14185 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:50:52.676568 14185 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260812 01:50:52.677629 14185 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:50:52.678030 14185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:50:52.703562 14185 rpc_server.cc:307] RPC server started. Bound to: 127.11.243.61:40289
I20260812 01:50:52.703569 14262 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.243.61:40289 every 8 connection(s)
I20260812 01:50:52.705636 14185 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data/info.pb
I20260812 01:50:52.708967 12236 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskOMow7D/build/asan/bin/kudu as pid 14185
I20260812 01:50:52.714695 14263 sys_catalog.cc:263] Verifying existing consensus state
I20260812 01:50:52.719851 14263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: Bootstrap starting.
I20260812 01:50:52.733446 14263 log.cc:826] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: Log is configured to *not* fsync() on all Append() calls
I20260812 01:50:52.768533 14263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: Bootstrap replayed 1/1 log segments. Stats: ops{read=40 overwritten=0 applied=35 ignored=0} inserts{seen=24 ignored=0} mutations{seen=22 ignored=0} orphaned_commits=0. Pending: 5 replicates
I20260812 01:50:52.769379 14263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: Bootstrap complete.
I20260812 01:50:52.775115 14263 raft_consensus.cc:359] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 3 FOLLOWER]: Replica starting. Triggering 5 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:52.779124 14263 raft_consensus.cc:740] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fef830de08489da4a25fb34cfd9737, State: Initialized, Role: FOLLOWER
I20260812 01:50:52.779783 14269 raft_consensus.cc:493] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a29998df1d9d480691e9c2654ae50c94)
I20260812 01:50:52.779996 14269 raft_consensus.cc:515] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:52.780058 14263 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 35, Last appended: 3.40, Last appended by leader: 40, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:52.781117 14271 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:52.781622 14271 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:50:52.781896 14269 leader_election.cc:290] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
I20260812 01:50:52.783434 14263 sys_catalog.cc:565] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 01:50:52.784842 14020 leader_election.cc:336] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215): Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
I20260812 01:50:52.790426 14231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "164a9e4e737b442f974a0af80ccce066" candidate_term: 5 candidate_status { last_received { term: 4 index: 41 } } ignore_live_leader: false dest_uuid: "d7fef830de08489da4a25fb34cfd9737" is_pre_election: true
I20260812 01:50:52.791049 14231 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 164a9e4e737b442f974a0af80ccce066 in term 3.
I20260812 01:50:52.791662 14021 leader_election.cc:304] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737; no voters: a29998df1d9d480691e9c2654ae50c94
I20260812 01:50:52.792088 14269 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 01:50:52.792272 14269 raft_consensus.cc:493] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a29998df1d9d480691e9c2654ae50c94)
I20260812 01:50:52.792407 14269 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 4 FOLLOWER]: Advancing to term 5
I20260812 01:50:52.796823 14269 raft_consensus.cc:515] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:52.797871 14269 leader_election.cc:290] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 5 election: Requested vote from peers d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
I20260812 01:50:52.799034 14231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "164a9e4e737b442f974a0af80ccce066" candidate_term: 5 candidate_status { last_received { term: 4 index: 41 } } ignore_live_leader: false dest_uuid: "d7fef830de08489da4a25fb34cfd9737"
I20260812 01:50:52.799331 14231 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 3 FOLLOWER]: Advancing to term 5
W20260812 01:50:52.799595 14020 leader_election.cc:336] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215): Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
I20260812 01:50:52.805981 14231 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 164a9e4e737b442f974a0af80ccce066 in term 5.
I20260812 01:50:52.806752 14021 leader_election.cc:304] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737; no voters: a29998df1d9d480691e9c2654ae50c94
I20260812 01:50:52.807406 14269 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 01:50:52.813918 14269 raft_consensus.cc:697] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [term 5 LEADER]: Becoming Leader. State: Replica: 164a9e4e737b442f974a0af80ccce066, State: Running, Role: LEADER
I20260812 01:50:52.814672 14269 consensus_queue.cc:237] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 41, Committed index: 41, Last appended: 4.41, Last appended by leader: 41, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:52.823992 14299 sys_catalog.cc:455] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 164a9e4e737b442f974a0af80ccce066. Latest consensus state: current_term: 5 leader_uuid: "164a9e4e737b442f974a0af80ccce066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:52.824406 14299 sys_catalog.cc:458] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [sys.catalog]: This master's current role is: LEADER
I20260812 01:50:52.828198 14296 catalog_manager.cc:1295] Loaded cluster ID: 4d89e47244e04cbeb6aca21d5d476cc2
I20260812 01:50:52.831756 14302 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 01:50:52.837447 14302 catalog_manager.cc:679] Loaded metadata for table default.table_6d36e1d186c948bf87645831e37e7b4d [id=1ea24853d5ae4ae9874c2ee442e9394c]
I20260812 01:50:52.837502 14296 catalog_manager.cc:1588] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: loading cluster ID for follower catalog manager: success
I20260812 01:50:52.838282 14302 catalog_manager.cc:679] Loaded metadata for table default.table_fce810b18eef421f8cb8d4fffce6a188 [id=38ffa4a422954b5f8a6acb79fbbd95a1]
I20260812 01:50:52.838904 14302 catalog_manager.cc:679] Loaded metadata for table default.table_05e4335fa3134a3495c1c0a5f1cd4313 [id=51c4aa84d04240d3939355629be68e6c]
I20260812 01:50:52.839507 14302 catalog_manager.cc:679] Loaded metadata for table default.table_4827643389f34e8b941a8b303a91aedf [id=53a003cadc7f44339fcad39937ba0ae1]
I20260812 01:50:52.840116 14302 catalog_manager.cc:679] Loaded metadata for table default.table_8f0e075a075f49719ed6cce7b86a8fe8 [id=5bd7338fec7d4410a97da1766eebf362]
I20260812 01:50:52.840854 14302 catalog_manager.cc:679] Loaded metadata for table default.table_9e18b143855f48a1ab04f0fbbb4a7130 [id=5f027eb5cb18441a8b12f882655a1897]
I20260812 01:50:52.841526 14302 catalog_manager.cc:679] Loaded metadata for table default.table_f6e57676e85d4df5b9e688ea19aa48f4 [id=aaf14e2a02484000ae521f9e08c5865e]
I20260812 01:50:52.841984 14302 catalog_manager.cc:679] Loaded metadata for table default.table_d3455b8ae1274ff0ab8eaf05f61734ba [id=c0f9109b45f942d9a4c6282519f618ec]
I20260812 01:50:52.842450 14302 catalog_manager.cc:679] Loaded metadata for table default.table_f04e78d3952146c88cb523c551527e23 [id=f4140461eb024e01ab55c03106c63a3c]
I20260812 01:50:52.844497 14296 catalog_manager.cc:1610] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: acquiring CA information for follower catalog manager: success
I20260812 01:50:52.845496 14302 tablet_loader.cc:96] loaded metadata for tablet 22bdb35d65454d60847e4b9747b1a784 (table default.table_f6e57676e85d4df5b9e688ea19aa48f4 [id=aaf14e2a02484000ae521f9e08c5865e])
I20260812 01:50:52.846180 14302 tablet_loader.cc:96] loaded metadata for tablet 65a3f8ef595c4beba8a6f53ff0091349 (table default.table_d3455b8ae1274ff0ab8eaf05f61734ba [id=c0f9109b45f942d9a4c6282519f618ec])
I20260812 01:50:52.846876 14302 tablet_loader.cc:96] loaded metadata for tablet 6efaedf1b58840de991c63a645e0dc39 (table default.table_4827643389f34e8b941a8b303a91aedf [id=53a003cadc7f44339fcad39937ba0ae1])
I20260812 01:50:52.847348 14302 tablet_loader.cc:96] loaded metadata for tablet 78507e1a5eb240038a518f5e279774d6 (table default.table_f04e78d3952146c88cb523c551527e23 [id=f4140461eb024e01ab55c03106c63a3c])
I20260812 01:50:52.848332 14296 catalog_manager.cc:1638] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 01:50:52.850042 14302 tablet_loader.cc:96] loaded metadata for tablet 8dc5fa33710b4bfa8421def7e4ff95f5 (table default.table_8f0e075a075f49719ed6cce7b86a8fe8 [id=5bd7338fec7d4410a97da1766eebf362])
I20260812 01:50:52.850787 14302 tablet_loader.cc:96] loaded metadata for tablet 984deca5cd434f4aaa770d64f8547fae (table default.table_fce810b18eef421f8cb8d4fffce6a188 [id=38ffa4a422954b5f8a6acb79fbbd95a1])
I20260812 01:50:52.851401 14302 tablet_loader.cc:96] loaded metadata for tablet c80bf9cfe58e4f62a7847d09e3260c48 (table default.table_9e18b143855f48a1ab04f0fbbb4a7130 [id=5f027eb5cb18441a8b12f882655a1897])
I20260812 01:50:52.852007 14302 tablet_loader.cc:96] loaded metadata for tablet d035719e90ad4710b0e391251cc8ae83 (table default.table_05e4335fa3134a3495c1c0a5f1cd4313 [id=51c4aa84d04240d3939355629be68e6c])
I20260812 01:50:52.852423 14302 tablet_loader.cc:96] loaded metadata for tablet d093fe48bace45f6ba626a54d0ce0e12 (table default.table_6d36e1d186c948bf87645831e37e7b4d [id=1ea24853d5ae4ae9874c2ee442e9394c])
I20260812 01:50:52.852761 14302 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 01:50:52.854476 14302 catalog_manager.cc:1295] Loaded cluster ID: 4d89e47244e04cbeb6aca21d5d476cc2
I20260812 01:50:52.854591 14302 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 01:50:52.856383 14302 catalog_manager.cc:1540] Loading token signing keys...
I20260812 01:50:52.857760 14302 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066: Loaded TSK: 0
I20260812 01:50:52.858985 14302 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 01:50:52.860276 14302 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260812 01:50:52.861577 14302 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: -1
I20260812 01:50:52.873232 14185 master_runner.cc:187] Error getting master registration for 127.11.243.60:33215: Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111),
I20260812 01:50:52.879357 14185 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:50:52.908581 14034 master_service.cc:960] ReplaceTablet: received request to replace tablet 65a3f8ef595c4beba8a6f53ff0091349 from {username='slave'} at 127.0.0.1:60736
I20260812 01:50:52.911149 14035 master_service.cc:960] ReplaceTablet: received request to replace tablet 65a3f8ef595c4beba8a6f53ff0091349 from {username='slave'} at 127.0.0.1:60736
I20260812 01:50:52.910890 14026 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60736:
name: "default.Table_6c51ddacf6294408824143a663c4b869"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:52.911541 14033 master_service.cc:960] ReplaceTablet: received request to replace tablet 7b799ee2aec842409248e21dfa769a52 from {username='slave'} at 127.0.0.1:60736
I20260812 01:50:52.912444 14033 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60736:
name: "default.Table_f0e2b03c1eff47bb8c727be64f93ae34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:52.912988 14032 master_service.cc:960] ReplaceTablet: received request to replace tablet 78507e1a5eb240038a518f5e279774d6 from {username='slave'} at 127.0.0.1:60736
I20260812 01:50:52.914527 14031 master_service.cc:960] ReplaceTablet: received request to replace tablet 6efaedf1b58840de991c63a645e0dc39 from {username='slave'} at 127.0.0.1:60736
I20260812 01:50:52.916323 14030 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60736:
table { table_name: "default.Table_fce810b18eef421f8cb8d4fffce6a188" } new_table_name: "default.Table_a1b47969379246018930d18eb3fcce51" modify_external_catalogs: true
I20260812 01:50:52.916965 14029 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60736:
name: "default.Table_3578677b7e834b98829f45191b94a17d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:50:52.917733 14028 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60736:
table { table_name: "default.Table_f6e57676e85d4df5b9e688ea19aa48f4" } modify_external_catalogs: true
I20260812 01:50:52.917986 14028 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60736:
table { table_name: "default.Table_f6e57676e85d4df5b9e688ea19aa48f4" } modify_external_catalogs: true
I20260812 01:50:52.918467 14027 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60736:
table { table_name: "default.Table_8f0e075a075f49719ed6cce7b86a8fe8" } modify_external_catalogs: true
I20260812 01:50:52.918685 14027 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60736:
table { table_name: "default.Table_8f0e075a075f49719ed6cce7b86a8fe8" } modify_external_catalogs: true
W20260812 01:50:52.922899 14020 consensus_peers.cc:597] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 -> Peer a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215): Couldn't send request to peer a29998df1d9d480691e9c2654ae50c94. Status: Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 01:50:52.929064 14231 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Refusing update from remote peer 164a9e4e737b442f974a0af80ccce066: Log matching property violated. Preceding OpId in replica: term: 3 index: 40. Preceding OpId from leader: term: 5 index: 44. (index mismatch)
I20260812 01:50:52.930313 14269 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 42, Last known committed idx: 35, Time since last communication: 0.000s
F20260812 01:50:52.933418 14095 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 1, previous 1; dumping first 2 out of 10 received events: NotificationEvent(eventId=1, eventTime=1786499439, eventType=CREATE_TABLE, dbName=default, tableName=table_05e4335fa3134a3495c1c0a5f1cd4313, message={"server":"","servicePrincipal":"","db":"default","table":"table_05e4335fa3134a3495c1c0a5f1cd4313","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_05e4335fa3134a3495c1c0a5f1cd4313\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786499439},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/warehouse/table_05e4335fa3134a3495c1c0a5f1cd4313\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_05e4335fa3134a3495c1c0a5f1cd4313\",\"kudu.table_id\":\"51c4aa84d04240d3939355629be68e6c\",\"transient_lastDdlTime\":\"1786499439\",\"comment\":\"\",\"kudu.master_addresses\":\"127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"4d89e47244e04cbeb6aca21d5d476cc2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786499439,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=1, eventTime=1786499439, eventType=CREATE_TABLE, dbName=default, tableName=table_6896943d0549474caa2928d9fd085a3a, message={"server":"","servicePrincipal":"","db":"default","table":"table_6896943d0549474caa2928d9fd085a3a","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_6896943d0549474caa2928d9fd085a3a\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786499439},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/warehouse/table_6896943d0549474caa2928d9fd085a3a\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_6896943d0549474caa2928d9fd085a3a\",\"kudu.table_id\":\"93dd830dcb7544e58258e468f73fb54a\",\"transient_lastDdlTime\":\"1786499439\",\"comment\":\"\",\"kudu.master_addresses\":\"127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"4d89e47244e04cbeb6aca21d5d476cc2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786499439,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f4cbda30d5d google::LogMessage::Fail() at ??:0
@ 0x7f4cbda34b23 google::LogMessage::SendToLog() at ??:0
@ 0x7f4cbda3075c google::LogMessage::Flush() at ??:0
@ 0x7f4cbda309a1 google::LogMessage::~LogMessage() at ??:0
@ 0x7f4cd46f9f64 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f4cd46f8811 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260812 01:50:52.964087 13257 heartbeater.cc:344] Connected to a master server at 127.11.243.61:40289
@ 0x7f4cd470048c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7f4cd4700309 std::_Function_handler<>::_M_invoke() at ??:0
I20260812 01:50:52.977875 14309 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "164a9e4e737b442f974a0af80ccce066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:52.978250 14309 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:50:52.979754 14271 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 164a9e4e737b442f974a0af80ccce066. Latest consensus state: current_term: 5 leader_uuid: "164a9e4e737b442f974a0af80ccce066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:52.980111 14271 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:50:52.980033 14219 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" instance_seqno: 1786499437993364) as {username='slave'} at 127.11.243.2:46949; Asking this server to re-register.
@ 0xaaf86d std::function<>::operator()() at ??:?
I20260812 01:50:52.981426 13257 heartbeater.cc:461] Registering TS with master...
I20260812 01:50:52.982875 14316 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "164a9e4e737b442f974a0af80ccce066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:52.983237 14316 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:50:52.983328 14303 mvcc.cc:204] Tried to move back new op lower bound from 7317501759134752768 to 7317501758735163392. Current Snapshot: MvccSnapshot[applied={T|T < 7317501759134752768}]
I20260812 01:50:52.983702 14219 ts_manager.cc:194] Registered new tserver with Master: e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853)
I20260812 01:50:52.986560 14034 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 164a9e4e737b442f974a0af80ccce066: Sending DeleteTablet for 3 replicas of tablet 65a3f8ef595c4beba8a6f53ff0091349
I20260812 01:50:52.986557 14316 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "164a9e4e737b442f974a0af80ccce066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:52.986867 14316 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:50:52.988469 14034 catalog_manager.cc:6807] ReplaceTablet: tablet 65a3f8ef595c4beba8a6f53ff0091349 deleted and replaced by tablet 259a3e5b30a64120ad305acaabd4432e
@ 0x7f4cc0758dd9 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f4cc3e286db start_thread at ??:0
@ 0x7f4cbc8df61f clone at ??:0
I20260812 01:50:53.131024 13094 heartbeater.cc:344] Connected to a master server at 127.11.243.61:40289
I20260812 01:50:53.133437 14219 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" instance_seqno: 1786499437297311) as {username='slave'} at 127.11.243.1:58987; Asking this server to re-register.
I20260812 01:50:53.134202 13094 heartbeater.cc:461] Registering TS with master...
I20260812 01:50:53.135653 14219 ts_manager.cc:194] Registered new tserver with Master: 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765)
I20260812 01:50:53.183449 13423 heartbeater.cc:344] Connected to a master server at 127.11.243.61:40289
I20260812 01:50:53.185734 14219 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" instance_seqno: 1786499438858305) as {username='slave'} at 127.11.243.3:38241; Asking this server to re-register.
I20260812 01:50:53.186468 13423 heartbeater.cc:461] Registering TS with master...
I20260812 01:50:53.188033 14219 ts_manager.cc:194] Registered new tserver with Master: 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
W20260812 01:50:53.287879 14322 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 01:50:52.991769 (+ 0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:50870 (local address 127.11.243.3:38197)
0812 01:50:53.011585 (+ 19816us) server_negotiation.cc:207] Beginning negotiation
0812 01:50:53.011593 (+ 8us) server_negotiation.cc:400] Waiting for connection header
0812 01:50:53.287455 (+275862us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50870: BlockingRecv error: recv got EOF from 127.0.0.1:50870 (error 108)
Metrics: {"server-negotiator.queue_time_us":19695,"thread_start_us":19568,"threads_started":1}
W20260812 01:50:53.288749 14324 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 01:50:52.992382 (+ 0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:52482 (local address 127.11.243.2:35853)
0812 01:50:53.010560 (+ 18178us) server_negotiation.cc:207] Beginning negotiation
0812 01:50:53.010567 (+ 7us) server_negotiation.cc:400] Waiting for connection header
0812 01:50:53.010592 (+ 25us) server_negotiation.cc:408] Connection header received
0812 01:50:53.010675 (+ 83us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0812 01:50:53.010681 (+ 6us) server_negotiation.cc:462] Received NEGOTIATE request from client
0812 01:50:53.010775 (+ 94us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0812 01:50:53.010900 (+ 125us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0812 01:50:53.287609 (+276709us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52482: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":18049,"thread_start_us":17904,"threads_started":1}
W20260812 01:50:53.289011 14320 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 01:50:52.988308 (+ 0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:60366 (local address 127.11.243.1:42765)
0812 01:50:53.001911 (+ 13603us) server_negotiation.cc:207] Beginning negotiation
0812 01:50:53.001920 (+ 9us) server_negotiation.cc:400] Waiting for connection header
0812 01:50:53.001945 (+ 25us) server_negotiation.cc:408] Connection header received
0812 01:50:53.002025 (+ 80us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0812 01:50:53.002033 (+ 8us) server_negotiation.cc:462] Received NEGOTIATE request from client
0812 01:50:53.002143 (+ 110us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0812 01:50:53.009031 (+ 6888us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0812 01:50:53.288553 (+279522us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60366: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":13433,"thread_start_us":16643,"threads_started":1}
W20260812 01:50:53.289554 13290 connection.cc:573] client connection to 127.11.243.62:40769 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 01:50:53.289881 12954 connection.cc:573] client connection to 127.11.243.62:40769 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 01:50:53.290854 13434 connection.cc:573] client connection to 127.11.243.62:40769 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 01:50:53.291070 14203 connection.cc:573] server connection from 127.0.0.1:54976 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 01:50:53.291641 13434 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.11.243.62:40769)
W20260812 01:50:53.292177 13434 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.11.243.62:40769)
W20260812 01:50:53.292430 13434 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.11.243.62:40769)
W20260812 01:50:53.292865 13434 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.11.243.62:40769)
I20260812 01:50:53.510685 14333 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 164a9e4e737b442f974a0af80ccce066)
I20260812 01:50:53.510944 14333 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:53.512681 14333 leader_election.cc:290] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
W20260812 01:50:53.513890 14206 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:50:53.515225 14206 leader_election.cc:336] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:50:53.515480 14205 leader_election.cc:336] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215): Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
I20260812 01:50:53.515631 14205 leader_election.cc:304] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fef830de08489da4a25fb34cfd9737; no voters: 164a9e4e737b442f974a0af80ccce066, a29998df1d9d480691e9c2654ae50c94
I20260812 01:50:53.515935 14333 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 01:50:54.084218 14341 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 164a9e4e737b442f974a0af80ccce066)
I20260812 01:50:54.084455 14341 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:54.085287 14341 leader_election.cc:290] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
W20260812 01:50:54.088142 14206 leader_election.cc:336] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:50:54.088397 14205 leader_election.cc:336] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215): Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
I20260812 01:50:54.088506 14205 leader_election.cc:304] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fef830de08489da4a25fb34cfd9737; no voters: 164a9e4e737b442f974a0af80ccce066, a29998df1d9d480691e9c2654ae50c94
I20260812 01:50:54.088801 14341 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 01:50:54.863596 12236 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskOMow7D/build/asan/bin/kudu pid 14185
I20260812 01:50:54.876339 14258 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:50:55.005468 12236 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskOMow7D/build/asan/bin/kudu with pid 14185
I20260812 01:50:55.862726 12236 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskOMow7D/build/asan/bin/kudu
/tmp/dist-test-taskOMow7D/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.243.61:40289
--webserver_interface=127.11.243.61
--webserver_port=46117
--builtin_ntp_servers=127.11.243.20:42563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--hive_metastore_uris=thrift://127.0.0.1:35039
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260812 01:50:56.238503 14354 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:50:56.238862 14354 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:50:56.239010 14354 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 01:50:56.248365 14354 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:50:56.248458 14354 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:50:56.248553 14354 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:50:56.248649 14354 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:50:56.259225 14354 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.243.20:42563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:35039
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.243.61:40289
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.243.61
--webserver_port=46117
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 1d9153c248733781bf69132f2d094d9d3c92b2bc
build type FASTDEBUG
built by None at 12 Aug 2026 01:45:57 UTC on bdcb31816ec0
build id 13298
ASAN enabled
I20260812 01:50:56.261186 14354 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:50:56.263275 14354 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 01:50:56.272213 14362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:50:56.272450 14363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:50:56.272554 14365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:50:56.273501 14354 server_base.cc:1061] running on GCE node
I20260812 01:50:56.274420 14354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:50:56.275931 14354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:50:56.277261 14354 hybrid_clock.cc:648] HybridClock initialized: now 1786499456277185 us; error 57 us; skew 500 ppm
I20260812 01:50:56.277632 14354 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:50:56.280032 14354 webserver.cc:533] Webserver started at http://127.11.243.61:46117/ using document root <none> and password file <none>
I20260812 01:50:56.280915 14354 fs_manager.cc:362] Metadata directory not provided
I20260812 01:50:56.281061 14354 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:50:56.287283 14354 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 01:50:56.291152 14372 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:50:56.292927 14354 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 01:50:56.293164 14354 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data,/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/wal
uuid: "d7fef830de08489da4a25fb34cfd9737"
format_stamp: "Formatted at 2026-08-12 01:50:35 on dist-test-slave-9gcw"
I20260812 01:50:56.294291 14354 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:50:56.322225 14354 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260812 01:50:56.323246 14354 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:50:56.323537 14354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:50:56.346499 14354 rpc_server.cc:307] RPC server started. Bound to: 127.11.243.61:40289
I20260812 01:50:56.346524 14440 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.243.61:40289 every 8 connection(s)
I20260812 01:50:56.348519 14354 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data/info.pb
I20260812 01:50:56.356113 14441 sys_catalog.cc:263] Verifying existing consensus state
I20260812 01:50:56.358206 12236 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskOMow7D/build/asan/bin/kudu as pid 14354
I20260812 01:50:56.360248 14441 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: Bootstrap starting.
I20260812 01:50:56.378473 14441 log.cc:826] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: Log is configured to *not* fsync() on all Append() calls
I20260812 01:50:56.415452 14441 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: Bootstrap replayed 1/1 log segments. Stats: ops{read=45 overwritten=0 applied=45 ignored=0} inserts{seen=31 ignored=0} mutations{seen=29 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 01:50:56.416146 14441 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: Bootstrap complete.
I20260812 01:50:56.421960 14441 raft_consensus.cc:359] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:56.422672 14441 raft_consensus.cc:740] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fef830de08489da4a25fb34cfd9737, State: Initialized, Role: FOLLOWER
I20260812 01:50:56.423364 14441 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 45, Last appended: 5.45, Last appended by leader: 45, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:56.424316 14447 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:50:56.424634 14447 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:50:56.425447 14441 sys_catalog.cc:565] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:50:56.439669 14467 catalog_manager.cc:1295] Loaded cluster ID: 4d89e47244e04cbeb6aca21d5d476cc2
I20260812 01:50:56.439853 14467 catalog_manager.cc:1588] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: loading cluster ID for follower catalog manager: success
I20260812 01:50:56.446022 14467 catalog_manager.cc:1610] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: acquiring CA information for follower catalog manager: success
I20260812 01:50:56.450160 14467 catalog_manager.cc:1638] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 01:50:56.451571 14354 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:50:56.456827 14354 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:50:56.517520 13257 heartbeater.cc:344] Connected to a master server at 127.11.243.61:40289
I20260812 01:50:56.520166 14392 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" instance_seqno: 1786499437993364) as {username='slave'} at 127.11.243.2:53239; Asking this server to re-register.
I20260812 01:50:56.521008 13257 heartbeater.cc:461] Registering TS with master...
I20260812 01:50:56.522935 14392 ts_manager.cc:194] Registered new tserver with Master: e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853)
I20260812 01:50:56.656888 13094 heartbeater.cc:344] Connected to a master server at 127.11.243.61:40289
I20260812 01:50:56.658425 14392 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" instance_seqno: 1786499437297311) as {username='slave'} at 127.11.243.1:60107; Asking this server to re-register.
I20260812 01:50:56.659168 13094 heartbeater.cc:461] Registering TS with master...
I20260812 01:50:56.660903 14392 ts_manager.cc:194] Registered new tserver with Master: 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765)
I20260812 01:50:56.709503 13423 heartbeater.cc:344] Connected to a master server at 127.11.243.61:40289
I20260812 01:50:56.711074 14392 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" instance_seqno: 1786499438858305) as {username='slave'} at 127.11.243.3:37345; Asking this server to re-register.
I20260812 01:50:56.711778 13423 heartbeater.cc:461] Registering TS with master...
I20260812 01:50:56.713359 14392 ts_manager.cc:194] Registered new tserver with Master: 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:50:56.826903 14447 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:56.827279 14447 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:56.829667 14447 leader_election.cc:290] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
W20260812 01:50:56.830473 14377 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:50:56.832217 14376 leader_election.cc:336] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215): Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
W20260812 01:50:56.832535 14377 leader_election.cc:336] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
I20260812 01:50:56.832674 14377 leader_election.cc:304] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fef830de08489da4a25fb34cfd9737; no voters: 164a9e4e737b442f974a0af80ccce066, a29998df1d9d480691e9c2654ae50c94
I20260812 01:50:56.833106 14447 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 01:50:57.568409 14480 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:57.568604 14480 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:57.569542 14480 leader_election.cc:290] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
W20260812 01:50:57.571880 14377 leader_election.cc:336] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:50:57.572130 14376 leader_election.cc:336] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215): Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
I20260812 01:50:57.572321 14376 leader_election.cc:304] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fef830de08489da4a25fb34cfd9737; no voters: 164a9e4e737b442f974a0af80ccce066, a29998df1d9d480691e9c2654ae50c94
I20260812 01:50:57.572579 14480 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 01:50:58.673301 14486 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:50:58.673535 14486 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:50:58.674206 14486 leader_election.cc:290] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
W20260812 01:50:58.677557 14376 leader_election.cc:336] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215): Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
W20260812 01:50:58.677773 14377 leader_election.cc:336] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
I20260812 01:50:58.677922 14377 leader_election.cc:304] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fef830de08489da4a25fb34cfd9737; no voters: 164a9e4e737b442f974a0af80ccce066, a29998df1d9d480691e9c2654ae50c94
I20260812 01:50:58.678227 14486 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 01:50:58.749410 12236 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskOMow7D/build/asan/bin/kudu pid 14354
I20260812 01:50:58.757555 14435 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:50:58.871305 12236 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskOMow7D/build/asan/bin/kudu with pid 14354
I20260812 01:50:59.486994 12236 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskOMow7D/build/asan/bin/kudu
/tmp/dist-test-taskOMow7D/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.243.61:40289
--webserver_interface=127.11.243.61
--webserver_port=46117
--builtin_ntp_servers=127.11.243.20:42563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--hive_metastore_uris=thrift://127.0.0.1:35039
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260812 01:50:59.867136 14502 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:50:59.867502 14502 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:50:59.867648 14502 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 01:50:59.876454 14502 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:50:59.876590 14502 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:50:59.876718 14502 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:50:59.876814 14502 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:50:59.887872 14502 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.243.20:42563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:35039
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.243.61:40289
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.243.61
--webserver_port=46117
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 1d9153c248733781bf69132f2d094d9d3c92b2bc
build type FASTDEBUG
built by None at 12 Aug 2026 01:45:57 UTC on bdcb31816ec0
build id 13298
ASAN enabled
I20260812 01:50:59.889698 14502 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:50:59.891609 14502 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 01:50:59.900502 14511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:50:59.900528 14510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:50:59.901432 14513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:50:59.902266 14502 server_base.cc:1061] running on GCE node
I20260812 01:50:59.903101 14502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:50:59.904938 14502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:50:59.906165 14502 hybrid_clock.cc:648] HybridClock initialized: now 1786499459906084 us; error 78 us; skew 500 ppm
I20260812 01:50:59.906545 14502 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:50:59.908830 14502 webserver.cc:533] Webserver started at http://127.11.243.61:46117/ using document root <none> and password file <none>
I20260812 01:50:59.909683 14502 fs_manager.cc:362] Metadata directory not provided
I20260812 01:50:59.909847 14502 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:50:59.915421 14502 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 01:50:59.918465 14523 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:50:59.919850 14502 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:50:59.920043 14502 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data,/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/wal
uuid: "d7fef830de08489da4a25fb34cfd9737"
format_stamp: "Formatted at 2026-08-12 01:50:35 on dist-test-slave-9gcw"
I20260812 01:50:59.920814 14502 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:50:59.971349 14502 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260812 01:50:59.972360 14502 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:50:59.972625 14502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:50:59.998483 14502 rpc_server.cc:307] RPC server started. Bound to: 127.11.243.61:40289
I20260812 01:50:59.998507 14593 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.243.61:40289 every 8 connection(s)
I20260812 01:51:00.000923 14502 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data/info.pb
I20260812 01:51:00.002456 12236 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskOMow7D/build/asan/bin/kudu as pid 14502
I20260812 01:51:00.011560 14594 sys_catalog.cc:263] Verifying existing consensus state
I20260812 01:51:00.016816 14594 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: Bootstrap starting.
I20260812 01:51:00.033066 14594 log.cc:826] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: Log is configured to *not* fsync() on all Append() calls
I20260812 01:51:00.044958 13257 heartbeater.cc:344] Connected to a master server at 127.11.243.61:40289
I20260812 01:51:00.072028 14594 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: Bootstrap replayed 1/1 log segments. Stats: ops{read=45 overwritten=0 applied=45 ignored=0} inserts{seen=31 ignored=0} mutations{seen=29 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 01:51:00.072613 14594 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: Bootstrap complete.
I20260812 01:51:00.081003 14594 raft_consensus.cc:359] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:00.081907 14594 raft_consensus.cc:740] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fef830de08489da4a25fb34cfd9737, State: Initialized, Role: FOLLOWER
I20260812 01:51:00.082572 14594 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 45, Last appended: 5.45, Last appended by leader: 45, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:00.083405 14599 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:51:00.083659 14599 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:51:00.084545 14594 sys_catalog.cc:565] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:51:00.096617 14615 catalog_manager.cc:1295] Loaded cluster ID: 4d89e47244e04cbeb6aca21d5d476cc2
I20260812 01:51:00.096827 14615 catalog_manager.cc:1588] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: loading cluster ID for follower catalog manager: success
I20260812 01:51:00.102236 14615 catalog_manager.cc:1610] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: acquiring CA information for follower catalog manager: success
I20260812 01:51:00.105347 14615 catalog_manager.cc:1638] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 01:51:00.108451 14502 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:51:00.114245 14502 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:51:00.183077 13094 heartbeater.cc:344] Connected to a master server at 127.11.243.61:40289
I20260812 01:51:00.186002 14547 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" instance_seqno: 1786499437297311) as {username='slave'} at 127.11.243.1:56649; Asking this server to re-register.
I20260812 01:51:00.186861 13094 heartbeater.cc:461] Registering TS with master...
I20260812 01:51:00.189530 14547 ts_manager.cc:194] Registered new tserver with Master: 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765)
I20260812 01:51:00.234935 13423 heartbeater.cc:344] Connected to a master server at 127.11.243.61:40289
I20260812 01:51:00.236604 14547 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" instance_seqno: 1786499438858305) as {username='slave'} at 127.11.243.3:44199; Asking this server to re-register.
I20260812 01:51:00.237500 13423 heartbeater.cc:461] Registering TS with master...
I20260812 01:51:00.239015 14547 ts_manager.cc:194] Registered new tserver with Master: 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:51:00.515951 14599 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:51:00.516263 14599 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:00.518476 14599 leader_election.cc:290] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
W20260812 01:51:00.519487 14527 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:51:00.521467 14526 leader_election.cc:336] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215): Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
W20260812 01:51:00.521720 14527 leader_election.cc:336] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
I20260812 01:51:00.521932 14527 leader_election.cc:304] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fef830de08489da4a25fb34cfd9737; no voters: 164a9e4e737b442f974a0af80ccce066, a29998df1d9d480691e9c2654ae50c94
I20260812 01:51:00.522346 14599 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 01:51:00.549937 14547 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" instance_seqno: 1786499437993364) as {username='slave'} at 127.11.243.2:35547; Asking this server to re-register.
I20260812 01:51:00.550835 13257 heartbeater.cc:461] Registering TS with master...
I20260812 01:51:00.552928 14546 ts_manager.cc:194] Registered new tserver with Master: e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853)
I20260812 01:51:01.263712 14624 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:51:01.263998 14624 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:01.264988 14624 leader_election.cc:290] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
W20260812 01:51:01.267437 14527 leader_election.cc:336] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:51:01.267640 14526 leader_election.cc:336] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215): Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
I20260812 01:51:01.267782 14526 leader_election.cc:304] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fef830de08489da4a25fb34cfd9737; no voters: 164a9e4e737b442f974a0af80ccce066, a29998df1d9d480691e9c2654ae50c94
I20260812 01:51:01.268051 14624 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 01:51:02.205236 14631 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:51:02.205458 14631 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:02.206184 14631 leader_election.cc:290] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
W20260812 01:51:02.208550 14527 leader_election.cc:336] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:51:02.208730 14526 leader_election.cc:336] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215): Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
I20260812 01:51:02.208905 14526 leader_election.cc:304] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fef830de08489da4a25fb34cfd9737; no voters: 164a9e4e737b442f974a0af80ccce066, a29998df1d9d480691e9c2654ae50c94
I20260812 01:51:02.209210 14631 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 01:51:03.270709 12236 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskOMow7D/build/asan/bin/kudu
/tmp/dist-test-taskOMow7D/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.243.60:33215
--webserver_interface=127.11.243.60
--webserver_port=45607
--builtin_ntp_servers=127.11.243.20:42563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--hive_metastore_uris=thrift://127.0.0.1:35039
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260812 01:51:03.635422 14646 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:51:03.635665 14646 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:03.636476 14646 leader_election.cc:290] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
W20260812 01:51:03.636704 14639 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:51:03.637311 14639 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:51:03.637506 14639 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 01:51:03.639282 14527 leader_election.cc:336] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:51:03.639513 14526 leader_election.cc:336] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215): Network error: Client connection negotiation failed: client connection to 127.11.243.60:33215: connect: Connection refused (error 111)
I20260812 01:51:03.639665 14526 leader_election.cc:304] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fef830de08489da4a25fb34cfd9737; no voters: 164a9e4e737b442f974a0af80ccce066, a29998df1d9d480691e9c2654ae50c94
I20260812 01:51:03.639936 14646 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260812 01:51:03.646888 14639 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:51:03.646981 14639 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:51:03.647074 14639 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:51:03.647161 14639 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:51:03.657750 14639 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.243.20:42563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:35039
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.243.60:33215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.243.60
--webserver_port=45607
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 1d9153c248733781bf69132f2d094d9d3c92b2bc
build type FASTDEBUG
built by None at 12 Aug 2026 01:45:57 UTC on bdcb31816ec0
build id 13298
ASAN enabled
I20260812 01:51:03.659549 14639 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:51:03.661558 14639 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 01:51:03.670948 14653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:51:03.670946 14652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:51:03.671397 14655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:51:03.671868 14639 server_base.cc:1061] running on GCE node
I20260812 01:51:03.672676 14639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:51:03.674204 14639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:51:03.675487 14639 hybrid_clock.cc:648] HybridClock initialized: now 1786499463675439 us; error 58 us; skew 500 ppm
I20260812 01:51:03.675899 14639 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:51:03.678586 14639 webserver.cc:533] Webserver started at http://127.11.243.60:45607/ using document root <none> and password file <none>
I20260812 01:51:03.679404 14639 fs_manager.cc:362] Metadata directory not provided
I20260812 01:51:03.679499 14639 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:51:03.685371 14639 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 01:51:03.688611 14664 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:51:03.690188 14639 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 01:51:03.690405 14639 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data,/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/wal
uuid: "a29998df1d9d480691e9c2654ae50c94"
format_stamp: "Formatted at 2026-08-12 01:50:36 on dist-test-slave-9gcw"
I20260812 01:51:03.691159 14639 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:51:03.707320 14639 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260812 01:51:03.708462 14639 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:51:03.708791 14639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:51:03.741990 14639 rpc_server.cc:307] RPC server started. Bound to: 127.11.243.60:33215
I20260812 01:51:03.742012 14728 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.243.60:33215 every 8 connection(s)
I20260812 01:51:03.744041 14639 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-2/data/info.pb
I20260812 01:51:03.749781 12236 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskOMow7D/build/asan/bin/kudu as pid 14639
I20260812 01:51:03.752327 14729 sys_catalog.cc:263] Verifying existing consensus state
I20260812 01:51:03.756108 14729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: Bootstrap starting.
I20260812 01:51:03.770457 14729 log.cc:826] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: Log is configured to *not* fsync() on all Append() calls
I20260812 01:51:03.808876 14729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: Bootstrap replayed 1/1 log segments. Stats: ops{read=41 overwritten=0 applied=41 ignored=0} inserts{seen=28 ignored=0} mutations{seen=26 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 01:51:03.809754 14729 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: Bootstrap complete.
I20260812 01:51:03.816985 14729 raft_consensus.cc:359] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:03.818125 14729 raft_consensus.cc:740] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29998df1d9d480691e9c2654ae50c94, State: Initialized, Role: FOLLOWER
I20260812 01:51:03.819007 14729 consensus_queue.cc:260] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 41, Last appended: 4.41, Last appended by leader: 41, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:03.819948 14733 sys_catalog.cc:455] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:51:03.820216 14733 sys_catalog.cc:458] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:51:03.821293 14729 sys_catalog.cc:565] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:51:03.837008 14750 catalog_manager.cc:1295] Loaded cluster ID: 4d89e47244e04cbeb6aca21d5d476cc2
I20260812 01:51:03.837134 14750 catalog_manager.cc:1588] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: loading cluster ID for follower catalog manager: success
I20260812 01:51:03.833293 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:51:03.838304 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:51:03.841859 14750 catalog_manager.cc:1610] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: acquiring CA information for follower catalog manager: success
I20260812 01:51:03.845116 14750 catalog_manager.cc:1638] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 01:51:04.056947 13253 heartbeater.cc:344] Connected to a master server at 127.11.243.60:33215
I20260812 01:51:04.060413 14684 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" instance_seqno: 1786499437993364) as {username='slave'} at 127.11.243.2:54967; Asking this server to re-register.
I20260812 01:51:04.061369 13253 heartbeater.cc:461] Registering TS with master...
I20260812 01:51:04.063619 14684 ts_manager.cc:194] Registered new tserver with Master: e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853)
I20260812 01:51:04.129210 13090 heartbeater.cc:344] Connected to a master server at 127.11.243.60:33215
I20260812 01:51:04.131078 14684 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" instance_seqno: 1786499437297311) as {username='slave'} at 127.11.243.1:40617; Asking this server to re-register.
I20260812 01:51:04.131929 13090 heartbeater.cc:461] Registering TS with master...
I20260812 01:51:04.133805 14684 ts_manager.cc:194] Registered new tserver with Master: 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765)
I20260812 01:51:04.235903 13419 heartbeater.cc:344] Connected to a master server at 127.11.243.60:33215
I20260812 01:51:04.236173 13419 heartbeater.cc:499] Master 127.11.243.60:33215 was elected leader, sending a full tablet report...
I20260812 01:51:04.238402 14684 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" instance_seqno: 1786499438858305) as {username='slave'} at 127.11.243.3:55319; Asking this server to re-register.
I20260812 01:51:04.239243 13419 heartbeater.cc:461] Registering TS with master...
I20260812 01:51:04.240799 14684 ts_manager.cc:194] Registered new tserver with Master: 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:51:04.335573 14754 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:51:04.335928 14754 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:04.338130 14754 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:51:04.339310 14670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:51:04.341648 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
I20260812 01:51:04.345968 14564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a29998df1d9d480691e9c2654ae50c94" candidate_term: 5 candidate_status { last_received { term: 4 index: 41 } } ignore_live_leader: false dest_uuid: "d7fef830de08489da4a25fb34cfd9737" is_pre_election: true
I20260812 01:51:04.346524 14564 raft_consensus.cc:2393] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29998df1d9d480691e9c2654ae50c94 in current term 5: Already voted for candidate 164a9e4e737b442f974a0af80ccce066 in this term.
I20260812 01:51:04.347486 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:51:04.347911 14754 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 4 FOLLOWER]: Advancing to term 5
I20260812 01:51:04.351831 14754 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260812 01:51:04.985280 14767 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:51:04.985601 14767 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:04.986441 14767 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
I20260812 01:51:04.988142 14564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a29998df1d9d480691e9c2654ae50c94" candidate_term: 6 candidate_status { last_received { term: 4 index: 41 } } ignore_live_leader: false dest_uuid: "d7fef830de08489da4a25fb34cfd9737" is_pre_election: true
I20260812 01:51:04.988592 14564 raft_consensus.cc:2410] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29998df1d9d480691e9c2654ae50c94 for term 6 because replica has last-logged OpId of term: 5 index: 45, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 41.
W20260812 01:51:04.989270 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
I20260812 01:51:04.989413 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:51:04.989686 14767 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 01:51:05.116264 14502 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:51:05.116508 14502 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:51:05.579181 14775 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:51:05.579401 14775 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:05.580278 14775 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
I20260812 01:51:05.581442 14564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a29998df1d9d480691e9c2654ae50c94" candidate_term: 6 candidate_status { last_received { term: 4 index: 41 } } ignore_live_leader: false dest_uuid: "d7fef830de08489da4a25fb34cfd9737" is_pre_election: true
I20260812 01:51:05.581780 14564 raft_consensus.cc:2410] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a29998df1d9d480691e9c2654ae50c94 for term 6 because replica has last-logged OpId of term: 5 index: 45, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 41.
W20260812 01:51:05.582490 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
I20260812 01:51:05.582614 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:51:05.582863 14775 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 01:51:05.959956 14781 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:51:05.960255 14781 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:05.961076 14781 leader_election.cc:290] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
W20260812 01:51:05.962313 14527 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111) [suppressed 7 similar messages]
W20260812 01:51:05.963989 14527 leader_election.cc:336] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
I20260812 01:51:05.969815 14696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7fef830de08489da4a25fb34cfd9737" candidate_term: 6 candidate_status { last_received { term: 5 index: 45 } } ignore_live_leader: false dest_uuid: "a29998df1d9d480691e9c2654ae50c94" is_pre_election: true
I20260812 01:51:05.970335 14696 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fef830de08489da4a25fb34cfd9737 in term 5.
I20260812 01:51:05.971114 14526 leader_election.cc:304] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94, d7fef830de08489da4a25fb34cfd9737; no voters: 164a9e4e737b442f974a0af80ccce066
I20260812 01:51:05.971483 14781 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 01:51:05.971608 14781 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:51:05.971694 14781 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 5 FOLLOWER]: Advancing to term 6
I20260812 01:51:05.976629 14781 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:05.977600 14781 leader_election.cc:290] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 election: Requested vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
I20260812 01:51:05.978370 14696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7fef830de08489da4a25fb34cfd9737" candidate_term: 6 candidate_status { last_received { term: 5 index: 45 } } ignore_live_leader: false dest_uuid: "a29998df1d9d480691e9c2654ae50c94"
I20260812 01:51:05.978596 14696 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 5 FOLLOWER]: Advancing to term 6
W20260812 01:51:05.979176 14527 leader_election.cc:336] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
I20260812 01:51:05.981110 14696 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fef830de08489da4a25fb34cfd9737 in term 6.
I20260812 01:51:05.981602 14526 leader_election.cc:304] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94, d7fef830de08489da4a25fb34cfd9737; no voters: 164a9e4e737b442f974a0af80ccce066
I20260812 01:51:05.981902 14781 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 01:51:05.982331 14781 raft_consensus.cc:697] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 6 LEADER]: Becoming Leader. State: Replica: d7fef830de08489da4a25fb34cfd9737, State: Running, Role: LEADER
I20260812 01:51:05.982823 14781 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 45, Committed index: 45, Last appended: 5.45, Last appended by leader: 45, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:05.985796 14787 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7fef830de08489da4a25fb34cfd9737. Latest consensus state: current_term: 6 leader_uuid: "d7fef830de08489da4a25fb34cfd9737" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:51:05.986057 14787 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: This master's current role is: LEADER
I20260812 01:51:05.986842 14792 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 01:51:05.989619 14792 catalog_manager.cc:679] Loaded metadata for table default.table_6d36e1d186c948bf87645831e37e7b4d [id=1ea24853d5ae4ae9874c2ee442e9394c]
I20260812 01:51:05.990036 14792 catalog_manager.cc:679] Loaded metadata for table default.table_fce810b18eef421f8cb8d4fffce6a188 [id=38ffa4a422954b5f8a6acb79fbbd95a1]
I20260812 01:51:05.990357 14792 catalog_manager.cc:679] Loaded metadata for table default.table_05e4335fa3134a3495c1c0a5f1cd4313 [id=51c4aa84d04240d3939355629be68e6c]
I20260812 01:51:05.990660 14792 catalog_manager.cc:679] Loaded metadata for table default.table_4827643389f34e8b941a8b303a91aedf [id=53a003cadc7f44339fcad39937ba0ae1]
I20260812 01:51:05.990947 14792 catalog_manager.cc:679] Loaded metadata for table default.table_8f0e075a075f49719ed6cce7b86a8fe8 [id=5bd7338fec7d4410a97da1766eebf362]
I20260812 01:51:05.991344 14792 catalog_manager.cc:679] Loaded metadata for table default.table_9e18b143855f48a1ab04f0fbbb4a7130 [id=5f027eb5cb18441a8b12f882655a1897]
I20260812 01:51:05.991668 14792 catalog_manager.cc:679] Loaded metadata for table default.table_f6e57676e85d4df5b9e688ea19aa48f4 [id=aaf14e2a02484000ae521f9e08c5865e]
I20260812 01:51:05.991963 14792 catalog_manager.cc:679] Loaded metadata for table default.table_d3455b8ae1274ff0ab8eaf05f61734ba [id=c0f9109b45f942d9a4c6282519f618ec]
I20260812 01:51:05.992252 14792 catalog_manager.cc:679] Loaded metadata for table default.table_f04e78d3952146c88cb523c551527e23 [id=f4140461eb024e01ab55c03106c63a3c]
I20260812 01:51:05.994560 14792 tablet_loader.cc:96] loaded metadata for tablet 1efdd54d32b140de96181edf0a814f22 (table default.table_f04e78d3952146c88cb523c551527e23 [id=f4140461eb024e01ab55c03106c63a3c])
I20260812 01:51:05.994891 14792 tablet_loader.cc:96] loaded metadata for tablet 22bdb35d65454d60847e4b9747b1a784 (table default.table_f6e57676e85d4df5b9e688ea19aa48f4 [id=aaf14e2a02484000ae521f9e08c5865e])
I20260812 01:51:05.995278 14792 tablet_loader.cc:96] loaded metadata for tablet 259a3e5b30a64120ad305acaabd4432e (table default.table_d3455b8ae1274ff0ab8eaf05f61734ba [id=c0f9109b45f942d9a4c6282519f618ec])
I20260812 01:51:05.996030 14792 tablet_loader.cc:96] loaded metadata for tablet 735f203da44e482ea2c4b24193b5eb1f (table default.table_4827643389f34e8b941a8b303a91aedf [id=53a003cadc7f44339fcad39937ba0ae1])
I20260812 01:51:05.996650 14792 tablet_loader.cc:96] loaded metadata for tablet 8dc5fa33710b4bfa8421def7e4ff95f5 (table default.table_8f0e075a075f49719ed6cce7b86a8fe8 [id=5bd7338fec7d4410a97da1766eebf362])
I20260812 01:51:05.996891 14792 tablet_loader.cc:96] loaded metadata for tablet 984deca5cd434f4aaa770d64f8547fae (table default.table_fce810b18eef421f8cb8d4fffce6a188 [id=38ffa4a422954b5f8a6acb79fbbd95a1])
I20260812 01:51:05.997426 14792 tablet_loader.cc:96] loaded metadata for tablet c80bf9cfe58e4f62a7847d09e3260c48 (table default.table_9e18b143855f48a1ab04f0fbbb4a7130 [id=5f027eb5cb18441a8b12f882655a1897])
I20260812 01:51:05.997778 14792 tablet_loader.cc:96] loaded metadata for tablet d035719e90ad4710b0e391251cc8ae83 (table default.table_05e4335fa3134a3495c1c0a5f1cd4313 [id=51c4aa84d04240d3939355629be68e6c])
I20260812 01:51:05.998029 14792 tablet_loader.cc:96] loaded metadata for tablet d093fe48bace45f6ba626a54d0ce0e12 (table default.table_6d36e1d186c948bf87645831e37e7b4d [id=1ea24853d5ae4ae9874c2ee442e9394c])
I20260812 01:51:05.998301 14792 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 01:51:05.999781 14792 catalog_manager.cc:1295] Loaded cluster ID: 4d89e47244e04cbeb6aca21d5d476cc2
I20260812 01:51:05.999881 14792 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 01:51:06.001709 14792 catalog_manager.cc:1540] Loading token signing keys...
I20260812 01:51:06.002964 14792 catalog_manager.cc:6103] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: Loaded TSK: 0
I20260812 01:51:06.004218 14792 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 01:51:06.005529 14792 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260812 01:51:06.006678 14792 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: -1
I20260812 01:51:06.081964 12236 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskOMow7D/build/asan/bin/kudu pid 14502
I20260812 01:51:06.095770 14589 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 01:51:06.218526 12236 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskOMow7D/build/asan/bin/kudu with pid 14502
W20260812 01:51:06.246801 12954 connection.cc:573] client connection to 127.11.243.61:40289 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 01:51:06.584995 13257 heartbeater.cc:499] Master 127.11.243.61:40289 was elected leader, sending a full tablet report...
I20260812 01:51:06.651916 14801 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:51:06.652187 14801 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:06.653105 14801 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:51:06.656039 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:51:06.656327 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:51:06.656440 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:51:06.656817 14801 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 01:51:06.769071 12236 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskOMow7D/build/asan/bin/kudu
/tmp/dist-test-taskOMow7D/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.243.61:40289
--webserver_interface=127.11.243.61
--webserver_port=46117
--builtin_ntp_servers=127.11.243.20:42563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--hive_metastore_uris=thrift://127.0.0.1:35039
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260812 01:51:07.141486 14806 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 01:51:07.141832 14806 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 01:51:07.141949 14806 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 01:51:07.151612 14806 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 01:51:07.151717 14806 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 01:51:07.151786 14806 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 01:51:07.151885 14806 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 01:51:07.163398 14806 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.243.20:42563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:35039
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.243.61:40289
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.243.61
--webserver_port=46117
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 1d9153c248733781bf69132f2d094d9d3c92b2bc
build type FASTDEBUG
built by None at 12 Aug 2026 01:45:57 UTC on bdcb31816ec0
build id 13298
ASAN enabled
I20260812 01:51:07.165305 14806 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 01:51:07.167197 14806 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260812 01:51:07.169559 14814 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:51:07.169754 14814 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:07.170567 14814 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:51:07.172963 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:51:07.173216 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:51:07.173373 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:51:07.173657 14814 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260812 01:51:07.176839 14821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:51:07.176824 14818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 01:51:07.177310 14824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 01:51:07.178691 14806 server_base.cc:1061] running on GCE node
I20260812 01:51:07.179548 14806 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 01:51:07.181110 14806 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 01:51:07.182382 14806 hybrid_clock.cc:648] HybridClock initialized: now 1786499467182294 us; error 78 us; skew 500 ppm
I20260812 01:51:07.182757 14806 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 01:51:07.185403 14806 webserver.cc:533] Webserver started at http://127.11.243.61:46117/ using document root <none> and password file <none>
I20260812 01:51:07.186199 14806 fs_manager.cc:362] Metadata directory not provided
I20260812 01:51:07.186347 14806 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 01:51:07.192552 14806 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.004s sys 0.002s
I20260812 01:51:07.196148 14831 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 01:51:07.197904 14806 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 01:51:07.198105 14806 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data,/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/wal
uuid: "d7fef830de08489da4a25fb34cfd9737"
format_stamp: "Formatted at 2026-08-12 01:50:35 on dist-test-slave-9gcw"
I20260812 01:51:07.198859 14806 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 01:51:07.221488 14806 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260812 01:51:07.222524 14806 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 01:51:07.222884 14806 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 01:51:07.246563 14806 rpc_server.cc:307] RPC server started. Bound to: 127.11.243.61:40289
I20260812 01:51:07.246687 14895 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.243.61:40289 every 8 connection(s)
I20260812 01:51:07.248447 14806 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/master-1/data/info.pb
I20260812 01:51:07.256532 12236 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskOMow7D/build/asan/bin/kudu as pid 14806
I20260812 01:51:07.258435 14896 sys_catalog.cc:263] Verifying existing consensus state
I20260812 01:51:07.263502 14896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: Bootstrap starting.
I20260812 01:51:07.268575 13094 heartbeater.cc:344] Connected to a master server at 127.11.243.61:40289
I20260812 01:51:07.280087 13423 heartbeater.cc:344] Connected to a master server at 127.11.243.61:40289
I20260812 01:51:07.281813 14896 log.cc:826] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: Log is configured to *not* fsync() on all Append() calls
I20260812 01:51:07.323784 14896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: Bootstrap replayed 1/1 log segments. Stats: ops{read=46 overwritten=0 applied=45 ignored=0} inserts{seen=31 ignored=0} mutations{seen=29 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260812 01:51:07.324584 14896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: Bootstrap complete.
I20260812 01:51:07.331301 14896 raft_consensus.cc:359] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 6 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:07.332468 14896 raft_consensus.cc:740] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fef830de08489da4a25fb34cfd9737, State: Initialized, Role: FOLLOWER
I20260812 01:51:07.333360 14896 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 45, Last appended: 6.46, Last appended by leader: 46, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:07.334656 14904 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:51:07.335098 14904 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 01:51:07.336308 14896 sys_catalog.cc:565] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 01:51:07.352192 14922 catalog_manager.cc:1295] Loaded cluster ID: 4d89e47244e04cbeb6aca21d5d476cc2
I20260812 01:51:07.352303 14922 catalog_manager.cc:1588] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: loading cluster ID for follower catalog manager: success
I20260812 01:51:07.350641 14806 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:51:07.357054 14922 catalog_manager.cc:1610] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: acquiring CA information for follower catalog manager: success
I20260812 01:51:07.357709 14806 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:51:07.360136 14922 catalog_manager.cc:1638] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 01:51:07.596763 13257 heartbeater.cc:344] Connected to a master server at 127.11.243.61:40289
I20260812 01:51:07.597047 13257 heartbeater.cc:499] Master 127.11.243.61:40289 was elected leader, sending a full tablet report...
I20260812 01:51:07.600422 14852 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e0adecc3c8034b71923a3a23c38549a9" instance_seqno: 1786499437993364) as {username='slave'} at 127.11.243.2:49347; Asking this server to re-register.
I20260812 01:51:07.601488 13257 heartbeater.cc:461] Registering TS with master...
I20260812 01:51:07.603814 14852 ts_manager.cc:194] Registered new tserver with Master: e0adecc3c8034b71923a3a23c38549a9 (127.11.243.2:35853)
I20260812 01:51:07.719110 14904 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:51:07.719444 14904 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:07.721958 14904 leader_election.cc:290] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
W20260812 01:51:07.722728 14836 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:51:07.737358 14836 leader_election.cc:336] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
I20260812 01:51:07.743307 14696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7fef830de08489da4a25fb34cfd9737" candidate_term: 7 candidate_status { last_received { term: 6 index: 46 } } ignore_live_leader: false dest_uuid: "a29998df1d9d480691e9c2654ae50c94" is_pre_election: true
I20260812 01:51:07.743623 14696 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fef830de08489da4a25fb34cfd9737 in term 6.
I20260812 01:51:07.744562 14835 leader_election.cc:304] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94, d7fef830de08489da4a25fb34cfd9737; no voters: 164a9e4e737b442f974a0af80ccce066
I20260812 01:51:07.745100 14904 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 01:51:07.745321 14904 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 01:51:07.745424 14904 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 6 FOLLOWER]: Advancing to term 7
I20260812 01:51:07.751422 14904 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:07.752868 14904 leader_election.cc:290] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 7 election: Requested vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), a29998df1d9d480691e9c2654ae50c94 (127.11.243.60:33215)
I20260812 01:51:07.752982 14696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7fef830de08489da4a25fb34cfd9737" candidate_term: 7 candidate_status { last_received { term: 6 index: 46 } } ignore_live_leader: false dest_uuid: "a29998df1d9d480691e9c2654ae50c94"
I20260812 01:51:07.753268 14696 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 6 FOLLOWER]: Advancing to term 7
W20260812 01:51:07.754163 14836 leader_election.cc:336] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
I20260812 01:51:07.756747 14696 raft_consensus.cc:2468] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fef830de08489da4a25fb34cfd9737 in term 7.
I20260812 01:51:07.757392 14835 leader_election.cc:304] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94, d7fef830de08489da4a25fb34cfd9737; no voters: 164a9e4e737b442f974a0af80ccce066
I20260812 01:51:07.757781 14904 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 01:51:07.758503 14904 raft_consensus.cc:697] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [term 7 LEADER]: Becoming Leader. State: Replica: d7fef830de08489da4a25fb34cfd9737, State: Running, Role: LEADER
I20260812 01:51:07.759171 14904 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 45, Committed index: 45, Last appended: 6.46, Last appended by leader: 46, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:07.762874 14933 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7fef830de08489da4a25fb34cfd9737. Latest consensus state: current_term: 7 leader_uuid: "d7fef830de08489da4a25fb34cfd9737" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } } }
I20260812 01:51:07.763280 14933 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737 [sys.catalog]: This master's current role is: LEADER
I20260812 01:51:07.764083 14935 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 01:51:07.767056 14935 catalog_manager.cc:679] Loaded metadata for table default.table_6d36e1d186c948bf87645831e37e7b4d [id=1ea24853d5ae4ae9874c2ee442e9394c]
I20260812 01:51:07.767550 14935 catalog_manager.cc:679] Loaded metadata for table default.table_fce810b18eef421f8cb8d4fffce6a188 [id=38ffa4a422954b5f8a6acb79fbbd95a1]
I20260812 01:51:07.767967 14935 catalog_manager.cc:679] Loaded metadata for table default.table_05e4335fa3134a3495c1c0a5f1cd4313 [id=51c4aa84d04240d3939355629be68e6c]
I20260812 01:51:07.768356 14935 catalog_manager.cc:679] Loaded metadata for table default.table_4827643389f34e8b941a8b303a91aedf [id=53a003cadc7f44339fcad39937ba0ae1]
I20260812 01:51:07.768718 14935 catalog_manager.cc:679] Loaded metadata for table default.table_8f0e075a075f49719ed6cce7b86a8fe8 [id=5bd7338fec7d4410a97da1766eebf362]
I20260812 01:51:07.769105 14935 catalog_manager.cc:679] Loaded metadata for table default.table_9e18b143855f48a1ab04f0fbbb4a7130 [id=5f027eb5cb18441a8b12f882655a1897]
I20260812 01:51:07.769531 14935 catalog_manager.cc:679] Loaded metadata for table default.table_f6e57676e85d4df5b9e688ea19aa48f4 [id=aaf14e2a02484000ae521f9e08c5865e]
I20260812 01:51:07.769892 14935 catalog_manager.cc:679] Loaded metadata for table default.table_d3455b8ae1274ff0ab8eaf05f61734ba [id=c0f9109b45f942d9a4c6282519f618ec]
I20260812 01:51:07.770258 14935 catalog_manager.cc:679] Loaded metadata for table default.table_f04e78d3952146c88cb523c551527e23 [id=f4140461eb024e01ab55c03106c63a3c]
I20260812 01:51:07.772836 14935 tablet_loader.cc:96] loaded metadata for tablet 1efdd54d32b140de96181edf0a814f22 (table default.table_f04e78d3952146c88cb523c551527e23 [id=f4140461eb024e01ab55c03106c63a3c])
I20260812 01:51:07.773304 14935 tablet_loader.cc:96] loaded metadata for tablet 22bdb35d65454d60847e4b9747b1a784 (table default.table_f6e57676e85d4df5b9e688ea19aa48f4 [id=aaf14e2a02484000ae521f9e08c5865e])
I20260812 01:51:07.773404 14852 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "3fa1f2b1b9b548df97a1878bfde765b5" instance_seqno: 1786499437297311) as {username='slave'} at 127.11.243.1:48803; Asking this server to re-register.
I20260812 01:51:07.774040 14935 tablet_loader.cc:96] loaded metadata for tablet 259a3e5b30a64120ad305acaabd4432e (table default.table_d3455b8ae1274ff0ab8eaf05f61734ba [id=c0f9109b45f942d9a4c6282519f618ec])
I20260812 01:51:07.774281 13094 heartbeater.cc:461] Registering TS with master...
I20260812 01:51:07.774981 14935 tablet_loader.cc:96] loaded metadata for tablet 735f203da44e482ea2c4b24193b5eb1f (table default.table_4827643389f34e8b941a8b303a91aedf [id=53a003cadc7f44339fcad39937ba0ae1])
I20260812 01:51:07.776003 14935 tablet_loader.cc:96] loaded metadata for tablet 8dc5fa33710b4bfa8421def7e4ff95f5 (table default.table_8f0e075a075f49719ed6cce7b86a8fe8 [id=5bd7338fec7d4410a97da1766eebf362])
I20260812 01:51:07.776144 14852 ts_manager.cc:194] Registered new tserver with Master: 3fa1f2b1b9b548df97a1878bfde765b5 (127.11.243.1:42765)
I20260812 01:51:07.776365 14935 tablet_loader.cc:96] loaded metadata for tablet 984deca5cd434f4aaa770d64f8547fae (table default.table_fce810b18eef421f8cb8d4fffce6a188 [id=38ffa4a422954b5f8a6acb79fbbd95a1])
I20260812 01:51:07.777064 14935 tablet_loader.cc:96] loaded metadata for tablet c80bf9cfe58e4f62a7847d09e3260c48 (table default.table_9e18b143855f48a1ab04f0fbbb4a7130 [id=5f027eb5cb18441a8b12f882655a1897])
I20260812 01:51:07.777601 14935 tablet_loader.cc:96] loaded metadata for tablet d035719e90ad4710b0e391251cc8ae83 (table default.table_05e4335fa3134a3495c1c0a5f1cd4313 [id=51c4aa84d04240d3939355629be68e6c])
I20260812 01:51:07.777999 14935 tablet_loader.cc:96] loaded metadata for tablet d093fe48bace45f6ba626a54d0ce0e12 (table default.table_6d36e1d186c948bf87645831e37e7b4d [id=1ea24853d5ae4ae9874c2ee442e9394c])
I20260812 01:51:07.778316 14935 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 01:51:07.779505 14935 catalog_manager.cc:1295] Loaded cluster ID: 4d89e47244e04cbeb6aca21d5d476cc2
I20260812 01:51:07.779613 14935 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 01:51:07.781838 14935 catalog_manager.cc:1540] Loading token signing keys...
I20260812 01:51:07.783222 14935 catalog_manager.cc:6103] T 00000000000000000000000000000000 P d7fef830de08489da4a25fb34cfd9737: Loaded TSK: 0
I20260812 01:51:07.784392 14935 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 01:51:07.784370 14852 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "0ced0a6dbcf2486183c801a3a84594d0" instance_seqno: 1786499438858305) as {username='slave'} at 127.11.243.3:37981; Asking this server to re-register.
I20260812 01:51:07.785244 13423 heartbeater.cc:461] Registering TS with master...
I20260812 01:51:07.786038 14935 catalog_manager.cc:1563] Loading latest processed Hive Metastore notification log event ID...
I20260812 01:51:07.787160 14852 ts_manager.cc:194] Registered new tserver with Master: 0ced0a6dbcf2486183c801a3a84594d0 (127.11.243.3:38197)
I20260812 01:51:07.787335 14935 catalog_manager.cc:5941] Last processed Hive Metastore notification event ID: -1
I20260812 01:51:07.900352 14852 master_service.cc:960] ReplaceTablet: received request to replace tablet 6efaedf1b58840de991c63a645e0dc39 from {username='slave'} at 127.0.0.1:35592
I20260812 01:51:07.900411 14850 master_service.cc:960] ReplaceTablet: received request to replace tablet 7b799ee2aec842409248e21dfa769a52 from {username='slave'} at 127.0.0.1:35592
I20260812 01:51:07.902875 14850 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35592:
table { table_name: "default.Table_fce810b18eef421f8cb8d4fffce6a188" } new_table_name: "default.Table_a1b47969379246018930d18eb3fcce51" modify_external_catalogs: true
I20260812 01:51:07.903203 14852 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35592:
name: "default.Table_1136408fd2f648dcbf9d582bb5764e10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:51:07.902681 14849 master_service.cc:960] ReplaceTablet: received request to replace tablet 7b799ee2aec842409248e21dfa769a52 from {username='slave'} at 127.0.0.1:35592
I20260812 01:51:07.903973 14845 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35592:
name: "default.Table_f7c1dac58da24fd6af0521dce0509188"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:51:07.904186 14842 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35592:
table { table_name: "default.Table_f04e78d3952146c88cb523c551527e23" } new_table_name: "default.Table_4b1538154ea5463f90b1549ebc72d0f7" modify_external_catalogs: true
I20260812 01:51:07.904587 14840 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35592:
table { table_name: "default.Table_4827643389f34e8b941a8b303a91aedf" } new_table_name: "default.Table_a9ac4ab0283e4af38523d6ba191bf686" modify_external_catalogs: true
I20260812 01:51:07.904671 14846 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35592:
name: "default.Table_9b0038bf6d4146199d2c1cd1ec263c7c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:51:07.905027 14848 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35592:
table { table_name: "default.Table_d3455b8ae1274ff0ab8eaf05f61734ba" } modify_external_catalogs: true
I20260812 01:51:07.905092 14841 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35592:
table { table_name: "default.Table_05e4335fa3134a3495c1c0a5f1cd4313" } new_table_name: "default.Table_4beba14d89f84ed5b3f67d5f527c4434" modify_external_catalogs: true
I20260812 01:51:07.905300 14848 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35592:
table { table_name: "default.Table_d3455b8ae1274ff0ab8eaf05f61734ba" } modify_external_catalogs: true
I20260812 01:51:07.904615 14843 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35592:
name: "default.Table_7bd2016211964bd680b0484ef89b4b4d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 01:51:07.906636 14849 master_service.cc:960] ReplaceTablet: received request to replace tablet 6efaedf1b58840de991c63a645e0dc39 from {username='slave'} at 127.0.0.1:35592
I20260812 01:51:07.907120 14849 master_service.cc:960] ReplaceTablet: received request to replace tablet 78507e1a5eb240038a518f5e279774d6 from {username='slave'} at 127.0.0.1:35592
I20260812 01:51:07.907675 14849 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35592:
name: "default.Table_3578677b7e834b98829f45191b94a17d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
F20260812 01:51:07.911154 14921 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 1, previous 1; dumping first 2 out of 10 received events: NotificationEvent(eventId=1, eventTime=1786499439, eventType=CREATE_TABLE, dbName=default, tableName=table_05e4335fa3134a3495c1c0a5f1cd4313, message={"server":"","servicePrincipal":"","db":"default","table":"table_05e4335fa3134a3495c1c0a5f1cd4313","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_05e4335fa3134a3495c1c0a5f1cd4313\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786499439},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/warehouse/table_05e4335fa3134a3495c1c0a5f1cd4313\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_05e4335fa3134a3495c1c0a5f1cd4313\",\"kudu.table_id\":\"51c4aa84d04240d3939355629be68e6c\",\"transient_lastDdlTime\":\"1786499439\",\"comment\":\"\",\"kudu.master_addresses\":\"127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"4d89e47244e04cbeb6aca21d5d476cc2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786499439,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=1, eventTime=1786499439, eventType=CREATE_TABLE, dbName=default, tableName=table_6896943d0549474caa2928d9fd085a3a, message={"server":"","servicePrincipal":"","db":"default","table":"table_6896943d0549474caa2928d9fd085a3a","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_6896943d0549474caa2928d9fd085a3a\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1786499439},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskOMow7D/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1786499417672976-12236-0/minicluster-data/warehouse/table_6896943d0549474caa2928d9fd085a3a\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_6896943d0549474caa2928d9fd085a3a\",\"kudu.table_id\":\"93dd830dcb7544e58258e468f73fb54a\",\"transient_lastDdlTime\":\"1786499439\",\"comment\":\"\",\"kudu.master_addresses\":\"127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"4d89e47244e04cbeb6aca21d5d476cc2\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1786499439,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7fd2797fad5d google::LogMessage::Fail() at ??:0
@ 0x7fd2797feb23 google::LogMessage::SendToLog() at ??:0
@ 0x7fd2797fa75c google::LogMessage::Flush() at ??:0
@ 0x7fd2797fa9a1 google::LogMessage::~LogMessage() at ??:0
@ 0x7fd2904c3f64 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7fd2904c2811 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7fd2904ca48c kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7fd2904ca309 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaaf86d std::function<>::operator()() at ??:?
@ 0x7fd27c522dd9 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fd27fbf26db start_thread at ??:0
@ 0x7fd2786a961f clone at ??:0
W20260812 01:51:08.126874 13127 connection.cc:573] client connection to 127.11.243.61:40289 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 01:51:08.127091 13434 connection.cc:573] client connection to 127.11.243.61:40289 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 01:51:08.128405 13434 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.11.243.61:40289)
W20260812 01:51:08.128887 13434 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.11.243.61:40289)
W20260812 01:51:08.129472 13434 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.11.243.61:40289)
W20260812 01:51:08.129778 13434 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.11.243.61:40289)
I20260812 01:51:08.841477 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:51:08.841753 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:51:09.752660 12236 master-stress-test.cc:579] Killing test thread 1/25
I20260812 01:51:10.857501 14958 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:51:10.857731 14958 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:10.858428 14958 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:51:10.859855 14670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111) [suppressed 6 similar messages]
W20260812 01:51:10.861527 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:51:10.861754 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:51:10.861889 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:51:10.862190 14958 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:51:13.843602 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:51:13.843969 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:51:15.989389 14971 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:51:15.989647 14971 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:15.990484 14971 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:51:15.991933 14670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 01:51:15.997593 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:51:15.997884 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:51:15.998034 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:51:15.998334 14971 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:51:18.845817 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:51:18.846068 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:51:20.103395 14982 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:51:20.103664 14982 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:20.104584 14982 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:51:20.107622 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:51:20.107885 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:51:20.107975 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:51:20.108218 14982 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:51:23.847673 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:51:23.847937 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:51:25.849936 14999 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:51:25.850216 14999 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:25.851085 14999 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:51:25.852700 14670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260812 01:51:25.854483 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:51:25.854792 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:51:25.854928 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:51:25.855314 14999 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:51:28.849639 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:51:28.849905 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:51:29.033406 15009 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:51:29.033867 15009 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:29.034761 15009 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:51:29.038607 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:51:29.038836 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:51:29.038971 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:51:29.039309 15009 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:51:33.851811 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:51:33.852069 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:51:38.854712 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:51:38.854974 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260812 01:51:39.433846 13254 heartbeater.cc:646] Failed to heartbeat to 127.11.243.62:40769 (92 consecutive failures): Network error: Failed to ping master at 127.11.243.62:40769: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:51:39.434068 13092 heartbeater.cc:646] Failed to heartbeat to 127.11.243.62:40769 (92 consecutive failures): Network error: Failed to ping master at 127.11.243.62:40769: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:51:39.872993 13423 heartbeater.cc:646] Failed to heartbeat to 127.11.243.61:40289 (61 consecutive failures): Network error: Failed to ping master at 127.11.243.61:40289: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:51:41.440639 15040 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:51:41.440907 15040 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:41.441706 15040 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:51:41.443018 14670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260812 01:51:41.444591 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:51:41.444842 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:51:41.445010 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:51:41.445331 15040 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:51:42.862675 15050 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:51:42.862941 15050 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:51:42.863610 15050 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:51:42.868129 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:51:42.868432 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:51:42.868556 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:51:42.868906 15050 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:51:43.856823 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:51:43.857050 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:51:48.858721 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:51:48.858960 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:51:53.860474 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:51:53.860692 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:51:58.862514 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:51:58.862726 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:52:02.216414 15101 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:52:02.216677 15101 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:52:02.218097 15101 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:52:02.219203 14670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260812 01:52:02.220856 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:52:02.221187 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:52:02.221318 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:52:02.221691 15101 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:52:03.864667 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:52:03.864954 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:52:08.866842 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:52:08.867084 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:52:13.868959 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:52:13.869234 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:52:17.768170 15143 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:52:17.768409 15143 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:52:17.769527 15143 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:52:17.771546 14670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 01:52:17.773600 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:52:17.773931 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:52:17.774067 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:52:17.774408 15143 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:52:18.870990 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:52:18.871277 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:52:23.873003 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:52:23.873286 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:52:25.488744 15164 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:52:25.489027 15164 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:52:25.490059 15164 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:52:25.491544 14670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 01:52:25.494688 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:52:25.494973 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:52:25.495141 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:52:25.495472 15164 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:52:28.875120 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:52:28.875411 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:52:33.877671 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:52:33.877945 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:52:38.880178 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:52:38.880460 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260812 01:52:39.546022 13094 heartbeater.cc:646] Failed to heartbeat to 127.11.243.61:40289 (182 consecutive failures): Network error: Failed to ping master at 127.11.243.61:40289: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
W20260812 01:52:39.617892 13254 heartbeater.cc:646] Failed to heartbeat to 127.11.243.62:40769 (212 consecutive failures): Network error: Failed to ping master at 127.11.243.62:40769: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:52:40.047688 13423 heartbeater.cc:646] Failed to heartbeat to 127.11.243.61:40289 (181 consecutive failures): Network error: Failed to ping master at 127.11.243.61:40289: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:52:43.882321 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:52:43.882632 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:52:45.415194 15215 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:52:45.415457 15215 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:52:45.416491 15215 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:52:45.418228 14670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 01:52:45.419994 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:52:45.420300 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:52:45.420415 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:52:45.420801 15215 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:52:48.891584 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:52:48.891835 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:52:53.893882 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:52:53.894188 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:52:58.896384 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:52:58.896680 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:53:00.953882 15259 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:53:00.954192 15259 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:53:00.955397 15259 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:53:00.956820 14670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 01:53:00.958324 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:53:00.958616 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:53:00.958792 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:53:00.959110 15259 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:53:03.898618 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:53:03.898937 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:53:03.902451 14672 maintenance_manager.cc:419] P a29998df1d9d480691e9c2654ae50c94: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033356
I20260812 01:53:03.974436 14671 maintenance_manager.cc:643] P a29998df1d9d480691e9c2654ae50c94: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.071s user 0.042s sys 0.000s Metrics: {"bytes_written":12645,"cfile_init":1,"dirs.queue_time_us":512,"dirs.run_cpu_time_us":267,"dirs.run_wall_time_us":1197,"drs_written":1,"lbm_read_time_us":87,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2050,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":26,"peak_mem_usage":0,"rows_written":28,"thread_start_us":746,"threads_started":2,"wal-append.queue_time_us":712}
I20260812 01:53:03.977797 14672 maintenance_manager.cc:419] P a29998df1d9d480691e9c2654ae50c94: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 1492 bytes on disk
I20260812 01:53:03.978827 14671 maintenance_manager.cc:643] P a29998df1d9d480691e9c2654ae50c94: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":85,"lbm_reads_lt_1ms":4}
I20260812 01:53:08.901000 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:53:08.901315 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:53:13.903446 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:53:13.903721 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:53:16.508711 15308 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:53:16.508946 15308 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:53:16.510030 15308 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:53:16.511704 14670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 01:53:16.518464 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:53:16.518831 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:53:16.518965 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:53:16.519348 15308 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:53:18.905804 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:53:18.906177 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:53:23.908429 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:53:23.908699 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:53:26.636202 15374 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:53:26.636482 15374 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:53:26.637524 15374 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:53:26.638906 14670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 01:53:26.640429 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:53:26.640743 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:53:26.640893 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:53:26.641219 15374 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:53:28.910867 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:53:28.911072 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:53:33.912691 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:53:33.912995 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:53:38.914800 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:53:38.915081 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260812 01:53:39.730983 13094 heartbeater.cc:646] Failed to heartbeat to 127.11.243.61:40289 (302 consecutive failures): Network error: Failed to ping master at 127.11.243.61:40289: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
W20260812 01:53:39.801679 13254 heartbeater.cc:646] Failed to heartbeat to 127.11.243.62:40769 (332 consecutive failures): Network error: Failed to ping master at 127.11.243.62:40769: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
I20260812 01:53:39.848377 15465 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:53:39.848663 15465 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:53:39.849542 15465 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:53:39.851876 14670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 01:53:39.853818 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:53:39.854089 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:53:39.854257 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:53:39.854573 15465 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260812 01:53:40.232338 13423 heartbeater.cc:646] Failed to heartbeat to 127.11.243.61:40289 (301 consecutive failures): Network error: Failed to ping master at 127.11.243.61:40289: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:53:43.917106 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:53:43.917402 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:53:48.919360 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:53:48.919634 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:53:53.921819 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:53:53.922102 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:53:54.306388 15546 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:53:54.306700 15546 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:53:54.307828 15546 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:53:54.309257 14670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 01:53:54.311084 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:53:54.311337 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:53:54.311458 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:53:54.311802 15546 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:53:58.924288 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:53:58.924654 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:53:59.903805 15585 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:53:59.904192 15585 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:53:59.905238 15585 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:53:59.907027 14670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 01:53:59.909391 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:53:59.909636 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:53:59.909752 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:53:59.910049 15585 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:54:03.664602 15609 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:54:03.664839 15609 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:54:03.665542 15609 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:54:03.671120 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:54:03.671447 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:54:03.671672 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:54:03.672040 15609 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:54:03.926033 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:54:03.926457 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:54:08.928851 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:54:08.929206 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:54:13.931283 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:54:13.931612 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:54:18.933889 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:54:18.934141 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:54:20.628475 15706 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:54:20.628854 15706 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:54:20.629931 15706 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:54:20.631639 14670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260812 01:54:20.633903 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:54:20.634269 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:54:20.634442 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:54:20.634877 15706 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:54:23.936636 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:54:23.937048 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:54:28.938828 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:54:28.939088 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:54:33.941677 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:54:33.941921 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:54:38.944015 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:54:38.944288 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:54:39.460114 15814 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:54:39.460379 15814 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:54:39.461598 15814 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:54:39.463279 14670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 01:54:39.464934 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:54:39.465229 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:54:39.465371 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:54:39.465747 15814 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260812 01:54:39.916448 13094 heartbeater.cc:646] Failed to heartbeat to 127.11.243.61:40289 (422 consecutive failures): Network error: Failed to ping master at 127.11.243.61:40289: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
W20260812 01:54:39.989037 13254 heartbeater.cc:646] Failed to heartbeat to 127.11.243.62:40769 (452 consecutive failures): Network error: Failed to ping master at 127.11.243.62:40769: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:54:40.418242 13423 heartbeater.cc:646] Failed to heartbeat to 127.11.243.61:40289 (421 consecutive failures): Network error: Failed to ping master at 127.11.243.61:40289: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:54:43.946125 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:54:43.946405 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:54:48.948068 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:54:48.948436 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:54:50.519203 15875 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:54:50.519436 15875 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:54:50.520388 15875 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:54:50.522360 14670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 01:54:50.523908 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:54:50.524132 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:54:50.524262 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:54:50.524560 15875 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:54:53.950313 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:54:53.950575 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:54:58.952802 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:54:58.953064 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:55:03.954994 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:55:03.955271 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:55:04.106956 15946 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:55:04.107198 15946 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:55:04.108078 15946 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:55:04.108853 14670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 01:55:04.110419 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:55:04.110616 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:55:04.110926 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:55:04.111304 15946 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:55:08.957249 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:55:08.957546 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:55:13.959015 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:55:13.959249 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:55:14.711786 16001 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:55:14.712203 16001 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:55:14.713400 16001 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:55:14.714712 14670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 01:55:14.716352 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:55:14.716555 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:55:14.716689 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:55:14.717018 16001 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:55:18.961048 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:55:18.961337 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:55:20.677378 16036 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:55:20.677744 16036 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:55:20.678642 16036 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:55:20.680485 14670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 01:55:20.682443 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:55:20.682690 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:55:20.682821 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:55:20.683235 16036 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:55:23.963472 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:55:23.963768 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:55:28.965791 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:55:28.966071 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:55:31.210956 16091 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:55:31.211200 16091 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:55:31.211949 16091 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:55:31.213675 14670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 01:55:31.215319 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:55:31.215559 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:55:31.215660 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:55:31.215904 16091 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:55:33.967841 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:55:33.968087 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:55:37.679215 16126 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:55:37.679489 16126 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:55:37.680604 16126 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:55:37.682307 14670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 01:55:37.684226 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:55:37.684641 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:55:37.684868 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:55:37.685256 16126 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:55:38.970176 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:55:38.970446 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260812 01:55:40.099943 13094 heartbeater.cc:646] Failed to heartbeat to 127.11.243.61:40289 (542 consecutive failures): Network error: Failed to ping master at 127.11.243.61:40289: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
W20260812 01:55:40.174890 13254 heartbeater.cc:646] Failed to heartbeat to 127.11.243.62:40769 (572 consecutive failures): Network error: Failed to ping master at 127.11.243.62:40769: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:55:40.601243 13423 heartbeater.cc:646] Failed to heartbeat to 127.11.243.61:40289 (541 consecutive failures): Network error: Failed to ping master at 127.11.243.61:40289: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:55:41.352133 16150 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:55:41.352461 16150 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:55:41.353554 16150 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:55:41.356429 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:55:41.356640 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:55:41.356724 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:55:41.357009 16150 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:55:41.745136 14672 maintenance_manager.cc:419] P a29998df1d9d480691e9c2654ae50c94: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 1492 bytes on disk
I20260812 01:55:41.752604 14671 maintenance_manager.cc:643] P a29998df1d9d480691e9c2654ae50c94: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.007s user 0.002s sys 0.004s Metrics: {"dirs.queue_time_us":615,"dirs.run_cpu_time_us":151,"dirs.run_wall_time_us":152,"thread_start_us":767,"threads_started":2,"wal-append.queue_time_us":464}
I20260812 01:55:43.972421 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:55:43.972623 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:55:46.208362 16179 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:55:46.208647 16179 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:55:46.209530 16179 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:55:46.211370 14670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260812 01:55:46.213456 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:55:46.213766 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:55:46.213892 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:55:46.214237 16179 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:55:48.974570 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:55:48.974777 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:55:49.963464 16198 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:55:49.963770 16198 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:55:49.964594 16198 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:55:49.967566 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:55:49.967724 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:55:49.967859 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:55:49.968183 16198 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:55:52.698558 16213 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:55:52.698869 16213 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:55:52.699692 16213 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:55:52.701043 14670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260812 01:55:52.702818 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:55:52.703043 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:55:52.703145 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:55:52.703405 16213 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:55:53.976548 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:55:53.976825 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:55:58.978677 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:55:58.979028 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:56:03.825003 16269 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:56:03.825337 16269 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:56:03.826311 16269 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:56:03.828071 14670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 01:56:03.830792 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:56:03.831055 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:56:03.831264 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:56:03.831573 16269 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 01:56:03.980816 14639 master_runner.cc:187] Error getting master registration for 127.11.243.62:40769: Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111),
I20260812 01:56:03.981213 14639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260812 01:56:08.226023 16291 raft_consensus.cc:493] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 01:56:08.226354 16291 raft_consensus.cc:515] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164a9e4e737b442f974a0af80ccce066" member_type: VOTER last_known_addr { host: "127.11.243.62" port: 40769 } } peers { permanent_uuid: "d7fef830de08489da4a25fb34cfd9737" member_type: VOTER last_known_addr { host: "127.11.243.61" port: 40289 } } peers { permanent_uuid: "a29998df1d9d480691e9c2654ae50c94" member_type: VOTER last_known_addr { host: "127.11.243.60" port: 33215 } }
I20260812 01:56:08.227268 16291 leader_election.cc:290] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769), d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289)
W20260812 01:56:08.230010 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 164a9e4e737b442f974a0af80ccce066 (127.11.243.62:40769): Network error: Client connection negotiation failed: client connection to 127.11.243.62:40769: connect: Connection refused (error 111)
W20260812 01:56:08.230239 14670 leader_election.cc:336] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7fef830de08489da4a25fb34cfd9737 (127.11.243.61:40289): Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
I20260812 01:56:08.230360 14670 leader_election.cc:304] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a29998df1d9d480691e9c2654ae50c94; no voters: 164a9e4e737b442f974a0af80ccce066, d7fef830de08489da4a25fb34cfd9737
I20260812 01:56:08.230729 16291 raft_consensus.cc:2749] T 00000000000000000000000000000000 P a29998df1d9d480691e9c2654ae50c94 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260812 01:56:08.601356 13434 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
W20260812 01:56:08.601789 13434 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
W20260812 01:56:08.601930 13434 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
W20260812 01:56:08.602021 13434 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
F20260812 01:56:08.613814 13474 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260812 01:56:08.614133 13448 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1136408fd2f648dcbf9d582bb5764e10 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.614482 13461 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260812 01:56:08.614133 13448 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1136408fd2f648dcbf9d582bb5764e10 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.614482 13461 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
*** Check failure stack trace: ***
*** Aborted at 1786499768 (unix time) try "date -d @1786499768" if you are using GNU date ***
F20260812 01:56:08.614133 13448 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1136408fd2f648dcbf9d582bb5764e10 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.614482 13461 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615453 13466 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260812 01:56:08.614133 13448 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1136408fd2f648dcbf9d582bb5764e10 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.614482 13461 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615453 13466 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615659 13462 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260812 01:56:08.614133 13448 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1136408fd2f648dcbf9d582bb5764e10 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.614482 13461 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615453 13466 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615659 13462 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615779 13442 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f0e2b03c1eff47bb8c727be64f93ae34 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F*** Check failure stack trace: ***
F20260812 01:56:08.614133 13448 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1136408fd2f648dcbf9d582bb5764e10 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.614482 13461 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615453 13466 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615659 13462 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615779 13442 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f0e2b03c1eff47bb8c727be64f93ae34 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615813 13463 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260812 01:56:08.614133 13448 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1136408fd2f648dcbf9d582bb5764e10 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.614482 13461 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615453 13466 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615659 13462 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615779 13442 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f0e2b03c1eff47bb8c727be64f93ae34 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615813 13463 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616117 13446 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6c51ddacf6294408824143a663c4b869 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260812 01:56:08.614133 13448 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1136408fd2f648dcbf9d582bb5764e10 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.614482 13461 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615453 13466 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615659 13462 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615779 13442 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f0e2b03c1eff47bb8c727be64f93ae34 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615813 13463 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616117 13446 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6c51ddacf6294408824143a663c4b869 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616459 13454 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260812 01:56:08.614133 13448 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1136408fd2f648dcbf9d582bb5764e10 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.614482 13461 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615453 13466 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615659 13462 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615779 13442 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f0e2b03c1eff47bb8c727be64f93ae34 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615813 13463 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616117 13446 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6c51ddacf6294408824143a663c4b869 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616459 13454 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617722 13450 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3578677b7e834b98829f45191b94a17d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260812 01:56:08.614133 13448 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1136408fd2f648dcbf9d582bb5764e10 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.614482 13461 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615453 13466 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615659 13462 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615779 13442 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f0e2b03c1eff47bb8c727be64f93ae34 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615813 13463 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616117 13446 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6c51ddacf6294408824143a663c4b869 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616459 13454 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617722 13450 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3578677b7e834b98829f45191b94a17d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617781 13440 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_928e3ae44e3245f3a62ae1724ccd100a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260812 01:56:08.614133 13448 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1136408fd2f648dcbf9d582bb5764e10 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.614482 13461 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615453 13466 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615659 13462 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615779 13442 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f0e2b03c1eff47bb8c727be64f93ae34 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615813 13463 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616117 13446 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6c51ddacf6294408824143a663c4b869 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616459 13454 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617722 13450 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3578677b7e834b98829f45191b94a17d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617781 13440 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_928e3ae44e3245f3a62ae1724ccd100a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617794 13447 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b0038bf6d4146199d2c1cd1ec263c7c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260812 01:56:08.614133 13448 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1136408fd2f648dcbf9d582bb5764e10 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.614482 13461 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615453 13466 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615659 13462 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615779 13442 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f0e2b03c1eff47bb8c727be64f93ae34 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615813 13463 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616117 13446 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6c51ddacf6294408824143a663c4b869 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616459 13454 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617722 13450 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3578677b7e834b98829f45191b94a17d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617781 13440 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_928e3ae44e3245f3a62ae1724ccd100a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617794 13447 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b0038bf6d4146199d2c1cd1ec263c7c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617889 13460 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260812 01:56:08.614133 13448 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1136408fd2f648dcbf9d582bb5764e10 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.614482 13461 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615453 13466 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615659 13462 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615779 13442 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f0e2b03c1eff47bb8c727be64f93ae34 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615813 13463 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616117 13446 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6c51ddacf6294408824143a663c4b869 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616459 13454 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617722 13450 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3578677b7e834b98829f45191b94a17d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617781 13440 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_928e3ae44e3245f3a62ae1724ccd100a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617794 13447 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b0038bf6d4146199d2c1cd1ec263c7c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617889 13460 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618357 13445 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_743419b26708420690c249d0256ab911 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260812 01:56:08.614133 13448 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1136408fd2f648dcbf9d582bb5764e10 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.614482 13461 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615453 13466 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615659 13462 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615779 13442 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f0e2b03c1eff47bb8c727be64f93ae34 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615813 13463 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616117 13446 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6c51ddacf6294408824143a663c4b869 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616459 13454 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617722 13450 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3578677b7e834b98829f45191b94a17d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617781 13440 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_928e3ae44e3245f3a62ae1724ccd100a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617794 13447 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b0038bf6d4146199d2c1cd1ec263c7c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617889 13460 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618357 13445 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_743419b26708420690c249d0256ab911 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618415 13468 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260812 01:56:08.614133 13448 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1136408fd2f648dcbf9d582bb5764e10 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.614482 13461 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615453 13466 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615659 13462 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615779 13442 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f0e2b03c1eff47bb8c727be64f93ae34 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615813 13463 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616117 13446 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6c51ddacf6294408824143a663c4b869 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616459 13454 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617722 13450 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3578677b7e834b98829f45191b94a17d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617781 13440 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_928e3ae44e3245f3a62ae1724ccd100a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617794 13447 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b0038bf6d4146199d2c1cd1ec263c7c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617889 13460 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618357 13445 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_743419b26708420690c249d0256ab911 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618415 13468 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618562 13449 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f7c1dac58da24fd6af0521dce0509188 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260812 01:56:08.614133 13448 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1136408fd2f648dcbf9d582bb5764e10 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.614482 13461 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615453 13466 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615659 13462 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615779 13442 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f0e2b03c1eff47bb8c727be64f93ae34 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615813 13463 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616117 13446 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6c51ddacf6294408824143a663c4b869 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616459 13454 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617722 13450 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3578677b7e834b98829f45191b94a17d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617781 13440 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_928e3ae44e3245f3a62ae1724ccd100a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617794 13447 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b0038bf6d4146199d2c1cd1ec263c7c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617889 13460 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618357 13445 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_743419b26708420690c249d0256ab911 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618415 13468 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618562 13449 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f7c1dac58da24fd6af0521dce0509188 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.619114 13441 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7bd2016211964bd680b0484ef89b4b4d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260812 01:56:08.614133 13448 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1136408fd2f648dcbf9d582bb5764e10 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.614482 13461 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615453 13466 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615659 13462 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615779 13442 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f0e2b03c1eff47bb8c727be64f93ae34 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615813 13463 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616117 13446 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6c51ddacf6294408824143a663c4b869 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616459 13454 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617722 13450 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3578677b7e834b98829f45191b94a17d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617781 13440 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_928e3ae44e3245f3a62ae1724ccd100a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617794 13447 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b0038bf6d4146199d2c1cd1ec263c7c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617889 13460 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618357 13445 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_743419b26708420690c249d0256ab911 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618415 13468 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618562 13449 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f7c1dac58da24fd6af0521dce0509188 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.619114 13441 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7bd2016211964bd680b0484ef89b4b4d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.620283 13458 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.620287 1*** Check failure stack trace: ***
F20260812 01:56:08.614133 13448 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1136408fd2f648dcbf9d582bb5764e10 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.614482 13461 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615453 13466 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615659 13462 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615779 13442 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f0e2b03c1eff47bb8c727be64f93ae34 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615813 13463 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616117 13446 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6c51ddacf6294408824143a663c4b869 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616459 13454 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617722 13450 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3578677b7e834b98829f45191b94a17d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617781 13440 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_928e3ae44e3245f3a62ae1724ccd100a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617794 13447 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b0038bf6d4146199d2c1cd1ec263c7c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617889 13460 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618357 13445 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_743419b26708420690c249d0256ab911 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618415 13468 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618562 13449 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f7c1dac58da24fd6af0521dce0509188 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.619114 13441 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7bd2016211964bd680b0484ef89b4b4d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.620283 13458 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.620287 13455 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260812 01:56:08.614133 13448 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1136408fd2f648dcbf9d582bb5764e10 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.614482 13461 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615453 13466 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615659 13462 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615779 13442 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f0e2b03c1eff47bb8c727be64f93ae34 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615813 13463 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616117 13446 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6c51ddacf6294408824143a663c4b869 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616459 13454 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617722 13450 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3578677b7e834b98829f45191b94a17d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617781 13440 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_928e3ae44e3245f3a62ae1724ccd100a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617794 13447 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b0038bf6d4146199d2c1cd1ec263c7c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617889 13460 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618357 13445 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_743419b26708420690c249d0256ab911 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618415 13468 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618562 13449 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f7c1dac58da24fd6af0521dce0509188 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.619114 13441 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7bd2016211964bd680b0484ef89b4b4d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.620283 13458 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.620287 13455 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.621732 13452 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65f203f5b94f4efb9d107338b6e02963 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260812 01:56:08.614133 13448 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1136408fd2f648dcbf9d582bb5764e10 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.614482 13461 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615453 13466 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615659 13462 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615779 13442 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f0e2b03c1eff47bb8c727be64f93ae34 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615813 13463 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616117 13446 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6c51ddacf6294408824143a663c4b869 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616459 13454 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617722 13450 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3578677b7e834b98829f45191b94a17d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617781 13440 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_928e3ae44e3245f3a62ae1724ccd100a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617794 13447 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b0038bf6d4146199d2c1cd1ec263c7c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617889 13460 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618357 13445 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_743419b26708420690c249d0256ab911 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618415 13468 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618562 13449 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f7c1dac58da24fd6af0521dce0509188 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.619114 13441 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7bd2016211964bd680b0484ef89b4b4d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.620283 13458 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.620287 13455 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.621732 13452 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65f203f5b94f4efb9d107338b6e02963 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.621804 13467 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260812 01:56:08.614133 13448 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1136408fd2f648dcbf9d582bb5764e10 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.614482 13461 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615453 13466 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615659 13462 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615779 13442 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f0e2b03c1eff47bb8c727be64f93ae34 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615813 13463 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616117 13446 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6c51ddacf6294408824143a663c4b869 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616459 13454 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617722 13450 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3578677b7e834b98829f45191b94a17d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617781 13440 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_928e3ae44e3245f3a62ae1724ccd100a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617794 13447 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b0038bf6d4146199d2c1cd1ec263c7c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617889 13460 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618357 13445 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_743419b26708420690c249d0256ab911 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618415 13468 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618562 13449 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f7c1dac58da24fd6af0521dce0509188 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.619114 13441 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7bd2016211964bd680b0484ef89b4b4d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.620283 13458 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.620287 13455 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.621732 13452 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65f203f5b94f4efb9d107338b6e02963 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.621804 13467 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.621944 13453 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260812 01:56:08.614133 13448 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1136408fd2f648dcbf9d582bb5764e10 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.614482 13461 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615453 13466 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615659 13462 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615779 13442 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f0e2b03c1eff47bb8c727be64f93ae34 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615813 13463 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616117 13446 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6c51ddacf6294408824143a663c4b869 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616459 13454 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617722 13450 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3578677b7e834b98829f45191b94a17d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617781 13440 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_928e3ae44e3245f3a62ae1724ccd100a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617794 13447 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b0038bf6d4146199d2c1cd1ec263c7c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617889 13460 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618357 13445 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_743419b26708420690c249d0256ab911 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618415 13468 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618562 13449 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f7c1dac58da24fd6af0521dce0509188 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.619114 13441 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7bd2016211964bd680b0484ef89b4b4d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.620283 13458 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.620287 13455 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.621732 13452 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65f203f5b94f4efb9d107338b6e02963 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.621804 13467 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.621944 13453 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.622157 13473 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260812 01:56:08.614133 13448 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_1136408fd2f648dcbf9d582bb5764e10 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.614482 13461 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615453 13466 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615659 13462 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615779 13442 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f0e2b03c1eff47bb8c727be64f93ae34 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.615813 13463 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616117 13446 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6c51ddacf6294408824143a663c4b869 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.616459 13454 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617722 13450 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_3578677b7e834b98829f45191b94a17d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617781 13440 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_928e3ae44e3245f3a62ae1724ccd100a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617794 13447 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b0038bf6d4146199d2c1cd1ec263c7c on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.617889 13460 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618357 13445 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_743419b26708420690c249d0256ab911 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618415 13468 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.618562 13449 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f7c1dac58da24fd6af0521dce0509188 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.619114 13441 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_7bd2016211964bd680b0484ef89b4b4d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.620283 13458 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.620287 13455 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.621732 13452 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_65f203f5b94f4efb9d107338b6e02963 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.621804 13467 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.621944 13453 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.622157 13473 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)F20260812 01:56:08.622396 13457 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.11.243.62:40769,127.11.243.61:40289,127.11.243.60:33215, num_attempts: 771) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.11.243.61:40289: connect: Connection refused (error 111)
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800002fcc) received by PID 12236 (TID 0x7feddf729700) from PID 12236; stack trace: ***
@ 0x7fedfec13980 (unknown) at ??:0
@ 0x7fedf79dfe87 gsignal at ??:0
@ 0x7fedf79e17f1 abort at ??:0
@ 0x7fedfa727d5d google::LogMessage::Fail() at ??:0
@ 0x7fedfa72bb23 google::LogMessage::SendToLog() at ??:0
@ 0x7fedfa72775c google::LogMessage::Flush() at ??:0
@ 0x7fedfa728ee9 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x40b4a5 kudu::MasterStressTest::ReplaceTabletThread() at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/master-stress-test.cc:393
@ 0x4472f4 std::__invoke_impl<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:73
@ 0x4471ad std::__invoke<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:95
@ 0x44716a _ZNSt6thread8_InvokerISt5tupleIJMN4kudu16MasterStressTestEFvvEPNS2_26MasterStressTest_Test_TestEEEE9_M_invokeIJLm0ELm1EEEEDTclsr3stdE8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:234
@ 0x44711e std::thread::_Invoker<>::operator()() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:243
@ 0x446e59 std::thread::_State_impl<>::_M_run() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:186
@ 0x7fedf80696df (unknown) at ??:0
@ 0x7fedfec086db start_thread at ??:0
@ 0x7fedf7ac261f clone at ??:0