Note: This is test shard 3 of 3.
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/2
2026-06-19T13:50:24Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-06-19T13:50:24Z Disabled control of system clock
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskGUcKrL/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskGUcKrL/thirdparty/src/hadoop-3.4.1/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL: jdbc:derby:/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/metadb;create=true
Metastore Connection Driver : org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User: APP
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.derby.sql
Initialization script completed
schemaTool completed
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/security.properties
2026-06-19 13:50:31: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskGUcKrL/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskGUcKrL/thirdparty/src/hadoop-3.4.1/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Starting hive metastore on port 0
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260619 13:50:39.635285 421 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
/tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.126:34929
--webserver_interface=127.0.105.126
--webserver_port=0
--builtin_ntp_servers=127.0.105.84:41509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--hive_metastore_uris=thrift://127.0.0.1:39807
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260619 13:50:40.006561 706 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 13:50:40.007009 706 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 13:50:40.007143 706 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260619 13:50:40.016273 706 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 13:50:40.016410 706 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260619 13:50:40.016534 706 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 13:50:40.016616 706 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260619 13:50:40.028005 706 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.84:41509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:39807
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.126:34929
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.105.126
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 19 Jun 2026 13:43:23 UTC on bdcb31816ec0
build id 12470
ASAN enabled
I20260619 13:50:40.029803 706 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 13:50:40.031996 706 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260619 13:50:40.042470 712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:50:40.043150 711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:50:40.044127 714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 13:50:40.044376 706 server_base.cc:1061] running on GCE node
I20260619 13:50:40.045435 706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 13:50:40.047099 706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 13:50:40.048396 706 hybrid_clock.cc:648] HybridClock initialized: now 1781877040048307 us; error 86 us; skew 500 ppm
I20260619 13:50:40.048889 706 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 13:50:40.052225 706 webserver.cc:533] Webserver started at http://127.0.105.126:45763/ using document root <none> and password file <none>
I20260619 13:50:40.053108 706 fs_manager.cc:362] Metadata directory not provided
I20260619 13:50:40.053231 706 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 13:50:40.053700 706 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 13:50:40.056264 706 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/data/instance:
uuid: "7adca601777549878be161a6116e53b6"
format_stamp: "Formatted at 2026-06-19 13:50:40 on dist-test-slave-7hnr"
I20260619 13:50:40.057140 706 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/wal/instance:
uuid: "7adca601777549878be161a6116e53b6"
format_stamp: "Formatted at 2026-06-19 13:50:40 on dist-test-slave-7hnr"
I20260619 13:50:40.062986 706 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260619 13:50:40.067355 720 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 13:50:40.068985 706 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260619 13:50:40.069216 706 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/data,/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/wal
uuid: "7adca601777549878be161a6116e53b6"
format_stamp: "Formatted at 2026-06-19 13:50:40 on dist-test-slave-7hnr"
I20260619 13:50:40.069427 706 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 13:50:40.105363 706 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260619 13:50:40.106317 706 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 13:50:40.106635 706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 13:50:40.129078 706 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.126:34929
I20260619 13:50:40.129099 771 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.126:34929 every 8 connection(s)
I20260619 13:50:40.130803 706 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/data/info.pb
I20260619 13:50:40.135490 421 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu as pid 706
I20260619 13:50:40.135838 421 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/wal/instance
I20260619 13:50:40.135954 772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:40.138638 421 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
/tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.125:37003
--webserver_interface=127.0.105.125
--webserver_port=0
--builtin_ntp_servers=127.0.105.84:41509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--hive_metastore_uris=thrift://127.0.0.1:39807
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260619 13:50:40.142269 772 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } has no permanent_uuid. Determining permanent_uuid...
I20260619 13:50:40.163153 772 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } has no permanent_uuid. Determining permanent_uuid...
W20260619 13:50:40.164537 723 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:50:40.166426 772 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:50:40.215919 772 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } attempt: 1
W20260619 13:50:40.218796 772 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:50:40.287137 772 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } attempt: 2
W20260619 13:50:40.289393 772 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:50:40.380753 772 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } attempt: 3
W20260619 13:50:40.383584 772 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:50:40.500466 773 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 13:50:40.500808 773 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 13:50:40.500880 773 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260619 13:50:40.510067 773 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 13:50:40.510181 773 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260619 13:50:40.510236 773 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 13:50:40.510277 773 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260619 13:50:40.520587 773 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.84:41509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:39807
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.125:37003
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.105.125
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 19 Jun 2026 13:43:23 UTC on bdcb31816ec0
build id 12470
ASAN enabled
I20260619 13:50:40.522658 773 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 13:50:40.524471 773 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260619 13:50:40.526855 772 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } attempt: 4
W20260619 13:50:40.528926 772 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:50:40.534601 782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:50:40.534068 781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:50:40.535184 784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 13:50:40.536026 773 server_base.cc:1061] running on GCE node
I20260619 13:50:40.536895 773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 13:50:40.538522 773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 13:50:40.539764 773 hybrid_clock.cc:648] HybridClock initialized: now 1781877040539732 us; error 58 us; skew 500 ppm
I20260619 13:50:40.540165 773 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 13:50:40.542514 773 webserver.cc:533] Webserver started at http://127.0.105.125:36357/ using document root <none> and password file <none>
I20260619 13:50:40.543303 773 fs_manager.cc:362] Metadata directory not provided
I20260619 13:50:40.543445 773 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 13:50:40.543798 773 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 13:50:40.548287 773 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data/instance:
uuid: "fe5c828398bf4cd592f4a0b084a304b7"
format_stamp: "Formatted at 2026-06-19 13:50:40 on dist-test-slave-7hnr"
I20260619 13:50:40.549111 773 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/wal/instance:
uuid: "fe5c828398bf4cd592f4a0b084a304b7"
format_stamp: "Formatted at 2026-06-19 13:50:40 on dist-test-slave-7hnr"
I20260619 13:50:40.554749 773 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260619 13:50:40.558471 790 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 13:50:40.559991 773 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 13:50:40.560235 773 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data,/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/wal
uuid: "fe5c828398bf4cd592f4a0b084a304b7"
format_stamp: "Formatted at 2026-06-19 13:50:40 on dist-test-slave-7hnr"
I20260619 13:50:40.560472 773 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 13:50:40.590518 773 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260619 13:50:40.591498 773 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 13:50:40.591807 773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 13:50:40.614452 773 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.125:37003
I20260619 13:50:40.614470 841 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.125:37003 every 8 connection(s)
I20260619 13:50:40.616165 773 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data/info.pb
I20260619 13:50:40.618654 421 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu as pid 773
I20260619 13:50:40.618903 421 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/wal/instance
I20260619 13:50:40.619941 421 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
/tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.124:40279
--webserver_interface=127.0.105.124
--webserver_port=0
--builtin_ntp_servers=127.0.105.84:41509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--hive_metastore_uris=thrift://127.0.0.1:39807
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260619 13:50:40.620806 842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:40.629257 842 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } has no permanent_uuid. Determining permanent_uuid...
I20260619 13:50:40.645203 842 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } has no permanent_uuid. Determining permanent_uuid...
I20260619 13:50:40.654959 842 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } has no permanent_uuid. Determining permanent_uuid...
W20260619 13:50:40.656414 791 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:50:40.658315 842 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.124:40279: Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:50:40.707713 842 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } attempt: 1
W20260619 13:50:40.709874 842 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.124:40279: Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:50:40.778126 842 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } attempt: 2
W20260619 13:50:40.780252 842 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.124:40279: Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:50:40.828266 772 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } attempt: 5
I20260619 13:50:40.836099 772 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } has no permanent_uuid. Determining permanent_uuid...
W20260619 13:50:40.838244 772 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.124:40279: Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:50:40.871555 842 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } attempt: 3
W20260619 13:50:40.873940 842 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.124:40279: Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:50:40.889601 772 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } attempt: 1
W20260619 13:50:40.891713 772 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.124:40279: Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:50:40.960042 772 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } attempt: 2
W20260619 13:50:40.962147 772 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.124:40279: Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:50:40.997849 843 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 13:50:40.998215 843 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 13:50:40.998294 843 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260619 13:50:41.007088 843 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 13:50:41.007210 843 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260619 13:50:41.007265 843 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 13:50:41.007305 843 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260619 13:50:41.017259 842 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } attempt: 4
I20260619 13:50:41.018574 843 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.84:41509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:39807
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.124:40279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.105.124
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 19 Jun 2026 13:43:23 UTC on bdcb31816ec0
build id 12470
ASAN enabled
W20260619 13:50:41.019569 842 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.124:40279: Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:50:41.020381 843 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 13:50:41.022325 843 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260619 13:50:41.030970 851 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:50:41.030941 852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:50:41.031621 854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 13:50:41.032245 843 server_base.cc:1061] running on GCE node
I20260619 13:50:41.033103 843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 13:50:41.034833 843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 13:50:41.036109 843 hybrid_clock.cc:648] HybridClock initialized: now 1781877041036055 us; error 81 us; skew 500 ppm
I20260619 13:50:41.036494 843 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 13:50:41.038888 843 webserver.cc:533] Webserver started at http://127.0.105.124:45257/ using document root <none> and password file <none>
I20260619 13:50:41.039695 843 fs_manager.cc:362] Metadata directory not provided
I20260619 13:50:41.039844 843 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 13:50:41.040225 843 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 13:50:41.042769 843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data/instance:
uuid: "6184e94a3ec241bfa8d2e34ea579f8a6"
format_stamp: "Formatted at 2026-06-19 13:50:41 on dist-test-slave-7hnr"
I20260619 13:50:41.043720 843 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/wal/instance:
uuid: "6184e94a3ec241bfa8d2e34ea579f8a6"
format_stamp: "Formatted at 2026-06-19 13:50:41 on dist-test-slave-7hnr"
I20260619 13:50:41.050272 843 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260619 13:50:41.054623 860 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 13:50:41.056438 843 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260619 13:50:41.056659 843 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data,/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/wal
uuid: "6184e94a3ec241bfa8d2e34ea579f8a6"
format_stamp: "Formatted at 2026-06-19 13:50:41 on dist-test-slave-7hnr"
I20260619 13:50:41.056898 843 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 13:50:41.068425 772 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } attempt: 3
W20260619 13:50:41.070518 772 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.105.124:40279: Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:50:41.082659 843 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260619 13:50:41.083628 843 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 13:50:41.083940 843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 13:50:41.106125 843 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.124:40279
I20260619 13:50:41.106145 911 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.124:40279 every 8 connection(s)
I20260619 13:50:41.108146 843 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data/info.pb
I20260619 13:50:41.111378 421 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu as pid 843
I20260619 13:50:41.111594 421 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/wal/instance
I20260619 13:50:41.113023 912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:41.120025 912 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } has no permanent_uuid. Determining permanent_uuid...
I20260619 13:50:41.136003 912 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } has no permanent_uuid. Determining permanent_uuid...
I20260619 13:50:41.145150 912 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } has no permanent_uuid. Determining permanent_uuid...
I20260619 13:50:41.160557 912 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: Bootstrap starting.
I20260619 13:50:41.164554 912 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:41.165900 912 log.cc:826] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: Log is configured to *not* fsync() on all Append() calls
I20260619 13:50:41.168812 912 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: No bootstrap required, opened a new log
I20260619 13:50:41.175177 912 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:41.175664 912 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:41.175822 912 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6184e94a3ec241bfa8d2e34ea579f8a6, State: Initialized, Role: FOLLOWER
I20260619 13:50:41.176578 912 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:41.177937 920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:41.178169 920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 13:50:41.179105 912 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: configured and running, proceeding with master startup.
W20260619 13:50:41.192991 934 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 13:50:41.193264 934 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 13:50:41.188638 843 master_runner.cc:187] Error getting master registration for 127.0.105.126:34929: OK, instance_id { permanent_uuid: "7adca601777549878be161a6116e53b6" instance_seqno: 1781877040123037 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260619 13:50:41.195046 843 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:50:41.247728 772 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } attempt: 4
I20260619 13:50:41.262859 772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6: Bootstrap starting.
I20260619 13:50:41.267731 772 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:41.269856 772 log.cc:826] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6: Log is configured to *not* fsync() on all Append() calls
I20260619 13:50:41.272554 772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6: No bootstrap required, opened a new log
I20260619 13:50:41.278133 772 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:41.278481 772 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:41.278637 772 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7adca601777549878be161a6116e53b6, State: Initialized, Role: FOLLOWER
I20260619 13:50:41.279366 772 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:41.280486 938 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:41.280826 938 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 13:50:41.281705 772 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 13:50:41.302915 706 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: OK, instance_id { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" instance_seqno: 1781877040608672 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260619 13:50:41.307641 706 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:50:41.313060 952 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 13:50:41.313222 952 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 13:50:41.318776 842 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } attempt: 5
I20260619 13:50:41.330438 842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: Bootstrap starting.
I20260619 13:50:41.333968 842 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:41.335142 842 log.cc:826] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: Log is configured to *not* fsync() on all Append() calls
W20260619 13:50:41.336143 866 tablet.cc:2406] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 13:50:41.338654 842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: No bootstrap required, opened a new log
I20260619 13:50:41.345139 842 raft_consensus.cc:359] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:41.345456 842 raft_consensus.cc:385] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:41.345626 842 raft_consensus.cc:740] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe5c828398bf4cd592f4a0b084a304b7, State: Initialized, Role: FOLLOWER
I20260619 13:50:41.346300 842 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:41.347280 956 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:41.347621 956 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 13:50:41.348491 842 sys_catalog.cc:565] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: configured and running, proceeding with master startup.
W20260619 13:50:41.359638 726 tablet.cc:2406] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 13:50:41.402561 773 master_runner.cc:264] No leader master found from master fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:50:41.402719 773 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:50:41.411720 971 catalog_manager.cc:1593] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 13:50:41.412024 971 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 13:50:41.452111 956 raft_consensus.cc:493] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:50:41.452419 956 raft_consensus.cc:515] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:41.454629 956 leader_election.cc:290] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
I20260619 13:50:41.455778 747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fe5c828398bf4cd592f4a0b084a304b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adca601777549878be161a6116e53b6" is_pre_election: true
I20260619 13:50:41.455690 887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fe5c828398bf4cd592f4a0b084a304b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" is_pre_election: true
I20260619 13:50:41.456688 887 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe5c828398bf4cd592f4a0b084a304b7 in term 0.
I20260619 13:50:41.456689 747 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe5c828398bf4cd592f4a0b084a304b7 in term 0.
I20260619 13:50:41.457406 791 leader_election.cc:304] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7; no voters:
I20260619 13:50:41.457973 956 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 13:50:41.458118 956 raft_consensus.cc:493] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 13:50:41.458206 956 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:41.461345 956 raft_consensus.cc:515] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:41.463541 747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fe5c828398bf4cd592f4a0b084a304b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7adca601777549878be161a6116e53b6"
I20260619 13:50:41.463779 747 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:41.467226 747 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe5c828398bf4cd592f4a0b084a304b7 in term 1.
I20260619 13:50:41.467880 793 leader_election.cc:304] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7adca601777549878be161a6116e53b6, fe5c828398bf4cd592f4a0b084a304b7; no voters:
I20260619 13:50:41.470417 887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fe5c828398bf4cd592f4a0b084a304b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6"
I20260619 13:50:41.470645 887 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:41.474191 887 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe5c828398bf4cd592f4a0b084a304b7 in term 1.
I20260619 13:50:41.475677 956 leader_election.cc:290] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 1 election: Requested vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
I20260619 13:50:41.476190 956 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 13:50:41.476663 956 raft_consensus.cc:697] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 1 LEADER]: Becoming Leader. State: Replica: fe5c828398bf4cd592f4a0b084a304b7, State: Running, Role: LEADER
I20260619 13:50:41.477454 956 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:41.493678 973 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe5c828398bf4cd592f4a0b084a304b7. Latest consensus state: current_term: 1 leader_uuid: "fe5c828398bf4cd592f4a0b084a304b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:41.494802 973 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: This master's current role is: LEADER
I20260619 13:50:41.496330 975 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260619 13:50:41.498864 975 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260619 13:50:41.515111 747 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 1 FOLLOWER]: Refusing update from remote peer fe5c828398bf4cd592f4a0b084a304b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 13:50:41.515316 887 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 1 FOLLOWER]: Refusing update from remote peer fe5c828398bf4cd592f4a0b084a304b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 13:50:41.516289 973 consensus_queue.cc:1048] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 13:50:41.519763 973 consensus_queue.cc:1048] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 13:50:41.551003 920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe5c828398bf4cd592f4a0b084a304b7. Latest consensus state: current_term: 1 leader_uuid: "fe5c828398bf4cd592f4a0b084a304b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:41.551321 920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 13:50:41.551707 938 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe5c828398bf4cd592f4a0b084a304b7. Latest consensus state: current_term: 1 leader_uuid: "fe5c828398bf4cd592f4a0b084a304b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:41.552379 938 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 13:50:41.552354 976 mvcc.cc:204] Tried to move back new op lower bound from 7298568362031128576 to 7298568361904168960. Current Snapshot: MvccSnapshot[applied={T|T < 7298568362031128576}]
I20260619 13:50:41.567286 977 mvcc.cc:204] Tried to move back new op lower bound from 7298568362031128576 to 7298568361904168960. Current Snapshot: MvccSnapshot[applied={T|T < 7298568362031128576}]
I20260619 13:50:41.565258 956 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fe5c828398bf4cd592f4a0b084a304b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:41.567929 956 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: This master's current role is: LEADER
I20260619 13:50:41.569360 973 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fe5c828398bf4cd592f4a0b084a304b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:41.569734 973 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: This master's current role is: LEADER
I20260619 13:50:41.571028 975 catalog_manager.cc:1382] Generated new cluster ID: 83fe01e7c5804ae9b7b2307f12c08ec9
I20260619 13:50:41.571134 975 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260619 13:50:41.573647 938 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fe5c828398bf4cd592f4a0b084a304b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:41.573841 938 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 13:50:41.575326 920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fe5c828398bf4cd592f4a0b084a304b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:41.575534 920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 13:50:41.599872 975 catalog_manager.cc:1405] Generated new certificate authority record
I20260619 13:50:41.601773 975 catalog_manager.cc:1539] Loading token signing keys...
I20260619 13:50:41.618919 975 catalog_manager.cc:6069] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: Generated new TSK 0
I20260619 13:50:41.620175 975 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260619 13:50:41.621657 975 catalog_manager.cc:1562] Loading latest processed Hive Metastore notification log event ID...
I20260619 13:50:41.623435 975 catalog_manager.cc:5918] Last processed Hive Metastore notification event ID: -1
I20260619 13:50:41.646910 421 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
/tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.65:0
--local_ip_for_outbound_sockets=127.0.105.65
--webserver_interface=127.0.105.65
--webserver_port=0
--tserver_master_addrs=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--builtin_ntp_servers=127.0.105.84:41509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260619 13:50:42.094566 985 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 13:50:42.094905 985 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 13:50:42.094987 985 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260619 13:50:42.104416 985 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260619 13:50:42.104597 985 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.65
I20260619 13:50:42.119328 989 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe5c828398bf4cd592f4a0b084a304b7)
I20260619 13:50:42.119567 989 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:42.120424 985 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.84:41509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.105.65
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.65
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 19 Jun 2026 13:43:23 UTC on bdcb31816ec0
build id 12470
ASAN enabled
I20260619 13:50:42.121097 989 leader_election.cc:290] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003)
I20260619 13:50:42.121853 747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7adca601777549878be161a6116e53b6" is_pre_election: true
I20260619 13:50:42.121966 817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe5c828398bf4cd592f4a0b084a304b7" is_pre_election: true
I20260619 13:50:42.122529 985 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 13:50:42.122902 863 leader_election.cc:304] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6184e94a3ec241bfa8d2e34ea579f8a6; no voters: 7adca601777549878be161a6116e53b6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:50:42.123600 989 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 13:50:42.125190 985 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260619 13:50:42.140707 992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:50:42.141227 991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:50:42.142246 994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 13:50:42.142983 985 server_base.cc:1061] running on GCE node
I20260619 13:50:42.143715 985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 13:50:42.145229 985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 13:50:42.146497 985 hybrid_clock.cc:648] HybridClock initialized: now 1781877042146446 us; error 44 us; skew 500 ppm
I20260619 13:50:42.146862 985 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 13:50:42.149271 985 webserver.cc:533] Webserver started at http://127.0.105.65:33187/ using document root <none> and password file <none>
I20260619 13:50:42.150261 985 fs_manager.cc:362] Metadata directory not provided
I20260619 13:50:42.150408 985 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 13:50:42.150817 985 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 13:50:42.153689 985 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-0/data/instance:
uuid: "380c26fd105f454cbe8ef6b87e35f41f"
format_stamp: "Formatted at 2026-06-19 13:50:42 on dist-test-slave-7hnr"
I20260619 13:50:42.154866 985 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-0/wal/instance:
uuid: "380c26fd105f454cbe8ef6b87e35f41f"
format_stamp: "Formatted at 2026-06-19 13:50:42 on dist-test-slave-7hnr"
I20260619 13:50:42.161134 985 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260619 13:50:42.165251 1000 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 13:50:42.166891 985 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 13:50:42.167058 985 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-0/wal
uuid: "380c26fd105f454cbe8ef6b87e35f41f"
format_stamp: "Formatted at 2026-06-19 13:50:42 on dist-test-slave-7hnr"
I20260619 13:50:42.167268 985 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 13:50:42.185711 985 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260619 13:50:42.186617 985 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 13:50:42.186905 985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 13:50:42.187922 985 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260619 13:50:42.189695 985 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 13:50:42.189787 985 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 13:50:42.189869 985 ts_tablet_manager.cc:616] Registered 0 tablets
I20260619 13:50:42.189926 985 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 13:50:42.195283 934 catalog_manager.cc:1294] Loaded cluster ID: 83fe01e7c5804ae9b7b2307f12c08ec9
I20260619 13:50:42.195428 934 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: loading cluster ID for follower catalog manager: success
I20260619 13:50:42.198982 934 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: acquiring CA information for follower catalog manager: success
I20260619 13:50:42.201468 934 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 13:50:42.229488 985 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.65:35865
I20260619 13:50:42.229609 1112 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.65:35865 every 8 connection(s)
I20260619 13:50:42.231196 985 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-0/data/info.pb
I20260619 13:50:42.236423 421 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu as pid 985
I20260619 13:50:42.236711 421 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-0/wal/instance
I20260619 13:50:42.244436 421 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
/tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.66:0
--local_ip_for_outbound_sockets=127.0.105.66
--webserver_interface=127.0.105.66
--webserver_port=0
--tserver_master_addrs=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--builtin_ntp_servers=127.0.105.84:41509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260619 13:50:42.269001 1113 heartbeater.cc:344] Connected to a master server at 127.0.105.124:40279
I20260619 13:50:42.269443 1113 heartbeater.cc:461] Registering TS with master...
I20260619 13:50:42.270418 1113 heartbeater.cc:507] Master 127.0.105.124:40279 requested a full tablet report, sending...
I20260619 13:50:42.273125 877 ts_manager.cc:194] Registered new tserver with Master: 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865)
I20260619 13:50:42.274925 1114 heartbeater.cc:344] Connected to a master server at 127.0.105.126:34929
I20260619 13:50:42.275084 1114 heartbeater.cc:461] Registering TS with master...
I20260619 13:50:42.275785 1114 heartbeater.cc:507] Master 127.0.105.126:34929 requested a full tablet report, sending...
I20260619 13:50:42.277791 1115 heartbeater.cc:344] Connected to a master server at 127.0.105.125:37003
I20260619 13:50:42.277872 737 ts_manager.cc:194] Registered new tserver with Master: 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865)
I20260619 13:50:42.277980 1115 heartbeater.cc:461] Registering TS with master...
I20260619 13:50:42.278429 1115 heartbeater.cc:507] Master 127.0.105.125:37003 requested a full tablet report, sending...
I20260619 13:50:42.280664 807 ts_manager.cc:194] Registered new tserver with Master: 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865)
I20260619 13:50:42.283156 807 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.65:52291
I20260619 13:50:42.315248 952 catalog_manager.cc:1294] Loaded cluster ID: 83fe01e7c5804ae9b7b2307f12c08ec9
I20260619 13:50:42.315357 952 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6: loading cluster ID for follower catalog manager: success
I20260619 13:50:42.318044 952 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6: acquiring CA information for follower catalog manager: success
I20260619 13:50:42.319861 952 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260619 13:50:42.642880 1123 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 13:50:42.643775 1123 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 13:50:42.643954 1123 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260619 13:50:42.653337 1123 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260619 13:50:42.653623 1123 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.66
I20260619 13:50:42.665349 1123 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.84:41509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.105.66
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.66
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 19 Jun 2026 13:43:23 UTC on bdcb31816ec0
build id 12470
ASAN enabled
I20260619 13:50:42.667121 1123 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 13:50:42.669003 1123 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260619 13:50:42.679675 1129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:50:42.680316 1128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:50:42.681658 1131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 13:50:42.681710 1123 server_base.cc:1061] running on GCE node
I20260619 13:50:42.682482 1123 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 13:50:42.683631 1123 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 13:50:42.684885 1123 hybrid_clock.cc:648] HybridClock initialized: now 1781877042684806 us; error 72 us; skew 500 ppm
I20260619 13:50:42.685240 1123 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 13:50:42.687505 1123 webserver.cc:533] Webserver started at http://127.0.105.66:41095/ using document root <none> and password file <none>
I20260619 13:50:42.688352 1123 fs_manager.cc:362] Metadata directory not provided
I20260619 13:50:42.688500 1123 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 13:50:42.688880 1123 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 13:50:42.691422 1123 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-1/data/instance:
uuid: "94599283b9334819b3bbe25509b7cd16"
format_stamp: "Formatted at 2026-06-19 13:50:42 on dist-test-slave-7hnr"
I20260619 13:50:42.692252 1123 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-1/wal/instance:
uuid: "94599283b9334819b3bbe25509b7cd16"
format_stamp: "Formatted at 2026-06-19 13:50:42 on dist-test-slave-7hnr"
I20260619 13:50:42.697947 1123 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260619 13:50:42.701591 1137 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 13:50:42.703152 1123 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 13:50:42.703365 1123 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-1/wal
uuid: "94599283b9334819b3bbe25509b7cd16"
format_stamp: "Formatted at 2026-06-19 13:50:42 on dist-test-slave-7hnr"
I20260619 13:50:42.703622 1123 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 13:50:42.731472 1123 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260619 13:50:42.732479 1123 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 13:50:42.732806 1123 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 13:50:42.733973 1123 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260619 13:50:42.735885 1123 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 13:50:42.736023 1123 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 13:50:42.736161 1123 ts_tablet_manager.cc:616] Registered 0 tablets
I20260619 13:50:42.736253 1123 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 13:50:42.778889 1123 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.66:33481
I20260619 13:50:42.778908 1249 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.66:33481 every 8 connection(s)
I20260619 13:50:42.781006 1123 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-1/data/info.pb
I20260619 13:50:42.784924 421 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu as pid 1123
I20260619 13:50:42.785161 421 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-1/wal/instance
I20260619 13:50:42.786159 1115 heartbeater.cc:499] Master 127.0.105.125:37003 was elected leader, sending a full tablet report...
I20260619 13:50:42.790967 421 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
/tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.105.67:0
--local_ip_for_outbound_sockets=127.0.105.67
--webserver_interface=127.0.105.67
--webserver_port=0
--tserver_master_addrs=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--builtin_ntp_servers=127.0.105.84:41509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260619 13:50:42.809824 1250 heartbeater.cc:344] Connected to a master server at 127.0.105.124:40279
I20260619 13:50:42.809881 1251 heartbeater.cc:344] Connected to a master server at 127.0.105.126:34929
I20260619 13:50:42.809798 1252 heartbeater.cc:344] Connected to a master server at 127.0.105.125:37003
I20260619 13:50:42.810398 1252 heartbeater.cc:461] Registering TS with master...
I20260619 13:50:42.810392 1250 heartbeater.cc:461] Registering TS with master...
I20260619 13:50:42.810392 1251 heartbeater.cc:461] Registering TS with master...
I20260619 13:50:42.811473 1251 heartbeater.cc:507] Master 127.0.105.126:34929 requested a full tablet report, sending...
I20260619 13:50:42.811503 1252 heartbeater.cc:507] Master 127.0.105.125:37003 requested a full tablet report, sending...
I20260619 13:50:42.812808 1250 heartbeater.cc:507] Master 127.0.105.124:40279 requested a full tablet report, sending...
I20260619 13:50:42.813807 737 ts_manager.cc:194] Registered new tserver with Master: 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481)
I20260619 13:50:42.813910 806 ts_manager.cc:194] Registered new tserver with Master: 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481)
I20260619 13:50:42.814863 806 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.66:34643
I20260619 13:50:42.816125 877 ts_manager.cc:194] Registered new tserver with Master: 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481)
I20260619 13:50:43.095712 1261 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe5c828398bf4cd592f4a0b084a304b7)
I20260619 13:50:43.095985 1261 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:43.096757 1261 leader_election.cc:290] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003)
I20260619 13:50:43.097494 817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe5c828398bf4cd592f4a0b084a304b7" is_pre_election: true
I20260619 13:50:43.097466 747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7adca601777549878be161a6116e53b6" is_pre_election: true
I20260619 13:50:43.098241 863 leader_election.cc:304] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6184e94a3ec241bfa8d2e34ea579f8a6; no voters: 7adca601777549878be161a6116e53b6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:50:43.098591 1261 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260619 13:50:43.173749 1260 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 13:50:43.174099 1260 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 13:50:43.174260 1260 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260619 13:50:43.184118 1260 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260619 13:50:43.184361 1260 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.105.67
I20260619 13:50:43.195068 1260 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.84:41509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.105.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.105.67
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.105.67
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 19 Jun 2026 13:43:23 UTC on bdcb31816ec0
build id 12470
ASAN enabled
I20260619 13:50:43.196887 1260 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 13:50:43.198964 1260 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260619 13:50:43.209874 1269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:50:43.209870 1266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:50:43.209825 1267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 13:50:43.210850 1260 server_base.cc:1061] running on GCE node
I20260619 13:50:43.211472 1260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 13:50:43.212494 1260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 13:50:43.213752 1260 hybrid_clock.cc:648] HybridClock initialized: now 1781877043213691 us; error 73 us; skew 500 ppm
I20260619 13:50:43.214090 1260 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 13:50:43.216747 1260 webserver.cc:533] Webserver started at http://127.0.105.67:37673/ using document root <none> and password file <none>
I20260619 13:50:43.217585 1260 fs_manager.cc:362] Metadata directory not provided
I20260619 13:50:43.217726 1260 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 13:50:43.218102 1260 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 13:50:43.220504 1260 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-2/data/instance:
uuid: "d54f30d62f034b35a8e73ff525ba43d9"
format_stamp: "Formatted at 2026-06-19 13:50:43 on dist-test-slave-7hnr"
I20260619 13:50:43.221276 1260 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-2/wal/instance:
uuid: "d54f30d62f034b35a8e73ff525ba43d9"
format_stamp: "Formatted at 2026-06-19 13:50:43 on dist-test-slave-7hnr"
I20260619 13:50:43.226619 1260 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260619 13:50:43.230298 1275 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 13:50:43.231732 1260 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 13:50:43.231938 1260 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-2/wal
uuid: "d54f30d62f034b35a8e73ff525ba43d9"
format_stamp: "Formatted at 2026-06-19 13:50:43 on dist-test-slave-7hnr"
I20260619 13:50:43.232157 1260 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 13:50:43.251396 1260 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260619 13:50:43.252413 1260 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 13:50:43.252774 1260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 13:50:43.253852 1260 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260619 13:50:43.255643 1260 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 13:50:43.255774 1260 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 13:50:43.255919 1260 ts_tablet_manager.cc:616] Registered 0 tablets
I20260619 13:50:43.256008 1260 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 13:50:43.296736 1260 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.67:33847
I20260619 13:50:43.296833 1387 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.67:33847 every 8 connection(s)
I20260619 13:50:43.298434 1260 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-2/data/info.pb
I20260619 13:50:43.305104 421 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu as pid 1260
I20260619 13:50:43.305323 421 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-2/wal/instance
I20260619 13:50:43.317811 1390 heartbeater.cc:344] Connected to a master server at 127.0.105.125:37003
I20260619 13:50:43.318094 1252 heartbeater.cc:499] Master 127.0.105.125:37003 was elected leader, sending a full tablet report...
I20260619 13:50:43.317898 1389 heartbeater.cc:344] Connected to a master server at 127.0.105.126:34929
I20260619 13:50:43.317855 1388 heartbeater.cc:344] Connected to a master server at 127.0.105.124:40279
I20260619 13:50:43.318439 1389 heartbeater.cc:461] Registering TS with master...
I20260619 13:50:43.318476 1388 heartbeater.cc:461] Registering TS with master...
I20260619 13:50:43.318334 1390 heartbeater.cc:461] Registering TS with master...
I20260619 13:50:43.320094 1390 heartbeater.cc:507] Master 127.0.105.125:37003 requested a full tablet report, sending...
I20260619 13:50:43.320134 1388 heartbeater.cc:507] Master 127.0.105.124:40279 requested a full tablet report, sending...
I20260619 13:50:43.320160 1389 heartbeater.cc:507] Master 127.0.105.126:34929 requested a full tablet report, sending...
I20260619 13:50:43.321695 806 ts_manager.cc:194] Registered new tserver with Master: d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
I20260619 13:50:43.321772 877 ts_manager.cc:194] Registered new tserver with Master: d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
I20260619 13:50:43.321954 737 ts_manager.cc:194] Registered new tserver with Master: d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
I20260619 13:50:43.322786 806 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.105.67:37621
I20260619 13:50:43.332399 421 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260619 13:50:43.367370 806 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58566:
name: "default.Table_c52ddc84a5e24c718eba7aab2234f558"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:43.370867 800 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58566:
name: "default.Table_2138876d1fe74e81bfc560e2fb592a0e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:43.367336 807 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58566:
name: "default.Table_1623c8da7f1e42958362607cf3bed6f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:43.369645 801 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58566:
name: "default.Table_8ba4a12b36bd4159a70fe23f31c1e862"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:43.372061 799 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58566:
name: "default.Table_75fff73b19164084879700104d9a214c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:43.368963 803 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58566:
name: "default.Table_71421a29531045198619e2e3d9383268"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:43.369688 802 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58566:
name: "default.Table_c1ef2fe395ec45c98ee34472a137d486"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:43.368072 805 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58566:
name: "default.Table_6a76b7745ccc406facfc1fc1021b24d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:43.372287 798 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58566:
name: "default.Table_06260aeaf35a4709a2f2596a0268c737"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:43.368129 804 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58566:
name: "default.Table_08f0dacfa3d348c9ab0e8387f52e681a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 13:50:43.388737 807 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_1623c8da7f1e42958362607cf3bed6f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 13:50:43.388741 806 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_c52ddc84a5e24c718eba7aab2234f558 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 13:50:43.403616 421 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu pid 773
I20260619 13:50:43.405035 837 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 13:50:43.487305 1435 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe5c828398bf4cd592f4a0b084a304b7)
I20260619 13:50:43.488476 1435 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:43.491312 887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7adca601777549878be161a6116e53b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" is_pre_election: true
I20260619 13:50:43.493172 1435 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
I20260619 13:50:43.568428 421 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu with pid 773
I20260619 13:50:43.568398 817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7adca601777549878be161a6116e53b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe5c828398bf4cd592f4a0b084a304b7" is_pre_election: true
W20260619 13:50:43.596441 1397 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.105.125:37003)
W20260619 13:50:43.614926 1401 negotiation.cc:336] Failed RPC negotiation. Trace:
0619 13:50:43.599926 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.0.105.125:37003 (local address 127.0.0.1:58570)
0619 13:50:43.601276 (+ 1350us) negotiation.cc:107] Waiting for socket to connect
0619 13:50:43.601300 (+ 24us) client_negotiation.cc:175] Beginning negotiation
0619 13:50:43.601480 (+ 180us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0619 13:50:43.612987 (+ 11507us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1087}
W20260619 13:50:43.638808 723 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:50:43.639189 723 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:50:43.639746 1435 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 13:50:43.685932 1439 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe5c828398bf4cd592f4a0b084a304b7)
I20260619 13:50:43.686239 1439 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:43.687639 747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7adca601777549878be161a6116e53b6" is_pre_election: true
I20260619 13:50:43.687925 747 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6184e94a3ec241bfa8d2e34ea579f8a6 in term 1.
I20260619 13:50:43.688668 863 leader_election.cc:304] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6184e94a3ec241bfa8d2e34ea579f8a6, 7adca601777549878be161a6116e53b6; no voters:
I20260619 13:50:43.691785 1439 leader_election.cc:290] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003)
I20260619 13:50:43.692013 1439 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260619 13:50:43.692158 1439 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe5c828398bf4cd592f4a0b084a304b7)
I20260619 13:50:43.692267 1439 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 1 FOLLOWER]: Advancing to term 2
I20260619 13:50:43.697686 1439 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:43.698669 1439 leader_election.cc:290] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 2 election: Requested vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003)
I20260619 13:50:43.708954 747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7adca601777549878be161a6116e53b6"
W20260619 13:50:43.708959 863 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:50:43.709273 747 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 1 FOLLOWER]: Advancing to term 2
I20260619 13:50:43.712237 747 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6184e94a3ec241bfa8d2e34ea579f8a6 in term 2.
I20260619 13:50:43.734205 863 leader_election.cc:304] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6184e94a3ec241bfa8d2e34ea579f8a6, 7adca601777549878be161a6116e53b6; no voters:
I20260619 13:50:43.734714 1440 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 13:50:43.734931 1440 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 2 LEADER]: Becoming Leader. State: Replica: 6184e94a3ec241bfa8d2e34ea579f8a6, State: Running, Role: LEADER
I20260619 13:50:43.735531 1440 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
W20260619 13:50:43.742260 863 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:50:43.743002 863 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:50:43.754168 1439 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6184e94a3ec241bfa8d2e34ea579f8a6. Latest consensus state: current_term: 2 leader_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:43.754468 1439 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: This master's current role is: LEADER
I20260619 13:50:43.773242 1444 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260619 13:50:43.775995 1444 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260619 13:50:43.777243 1444 catalog_manager.cc:1294] Loaded cluster ID: 83fe01e7c5804ae9b7b2307f12c08ec9
I20260619 13:50:43.777468 1444 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260619 13:50:43.779047 1444 catalog_manager.cc:1539] Loading token signing keys...
I20260619 13:50:43.780189 1444 catalog_manager.cc:6080] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: Loaded TSK: 0
I20260619 13:50:43.781457 1444 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260619 13:50:43.783170 1444 catalog_manager.cc:1562] Loading latest processed Hive Metastore notification log event ID...
I20260619 13:50:43.784193 1444 catalog_manager.cc:5918] Last processed Hive Metastore notification event ID: -1
I20260619 13:50:43.792475 875 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49906:
name: "default.Table_2138876d1fe74e81bfc560e2fb592a0e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:43.792887 876 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49906:
name: "default.Table_75fff73b19164084879700104d9a214c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 13:50:43.794823 1115 heartbeater.cc:646] Failed to heartbeat to 127.0.105.125:37003 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:50:43.795521 871 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49906:
name: "default.Table_6a76b7745ccc406facfc1fc1021b24d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:43.794955 873 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49906:
name: "default.Table_1623c8da7f1e42958362607cf3bed6f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:43.797709 868 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49906:
name: "default.Table_c1ef2fe395ec45c98ee34472a137d486"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:43.799360 877 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49906:
name: "default.Table_06260aeaf35a4709a2f2596a0268c737"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:43.799500 870 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49906:
name: "default.Table_08f0dacfa3d348c9ab0e8387f52e681a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:43.798240 872 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49906:
name: "default.Table_c52ddc84a5e24c718eba7aab2234f558"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:43.800302 874 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49906:
name: "default.Table_8ba4a12b36bd4159a70fe23f31c1e862"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:43.803284 869 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49906:
name: "default.Table_71421a29531045198619e2e3d9383268"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 13:50:43.808516 875 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2138876d1fe74e81bfc560e2fb592a0e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 13:50:43.812819 871 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_6a76b7745ccc406facfc1fc1021b24d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 13:50:43.814152 876 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_75fff73b19164084879700104d9a214c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 13:50:43.815371 873 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_1623c8da7f1e42958362607cf3bed6f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 13:50:43.816500 868 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_c1ef2fe395ec45c98ee34472a137d486 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 13:50:43.817797 872 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_c52ddc84a5e24c718eba7aab2234f558 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 13:50:43.819034 877 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_06260aeaf35a4709a2f2596a0268c737 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 13:50:43.820128 874 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_8ba4a12b36bd4159a70fe23f31c1e862 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 13:50:43.821178 870 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_08f0dacfa3d348c9ab0e8387f52e681a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260619 13:50:43.822221 869 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_71421a29531045198619e2e3d9383268 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 13:50:43.825023 1390 heartbeater.cc:499] Master 127.0.105.125:37003 was elected leader, sending a full tablet report...
W20260619 13:50:43.839691 1252 heartbeater.cc:646] Failed to heartbeat to 127.0.105.125:37003 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:50:43.844041 1390 heartbeater.cc:646] Failed to heartbeat to 127.0.105.125:37003 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:50:43.921173 875 catalog_manager.cc:2199] created HMS catalog entry for table [id=57c8bf0937b84407ace807934df053c4]
W20260619 13:50:43.930826 863 consensus_peers.cc:597] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 -> Peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Couldn't send request to peer fe5c828398bf4cd592f4a0b084a304b7. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260619 13:50:43.932078 747 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 2 FOLLOWER]: Refusing update from remote peer 6184e94a3ec241bfa8d2e34ea579f8a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20260619 13:50:43.932845 1439 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260619 13:50:43.958546 1435 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6184e94a3ec241bfa8d2e34ea579f8a6. Latest consensus state: current_term: 2 leader_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:43.958810 1435 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 13:50:43.962731 1440 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:43.963038 1440 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: This master's current role is: LEADER
I20260619 13:50:43.968554 871 catalog_manager.cc:2199] created HMS catalog entry for table [id=d0fb54a9a55b4a3b83f7c809ef7d24ea]
I20260619 13:50:43.969117 1449 mvcc.cc:204] Tried to move back new op lower bound from 7298568371928498176 to 7298568371145728000. Current Snapshot: MvccSnapshot[applied={T|T < 7298568371928498176}]
I20260619 13:50:43.970559 875 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49906:
table { table_name: "default.Table_2138876d1fe74e81bfc560e2fb592a0e" } new_table_name: "default.Table_a2e4bb5b93bf49e1aa8c0181d2b1a362" modify_external_catalogs: true
I20260619 13:50:43.980788 1435 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:43.981034 1435 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 13:50:43.997154 871 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49906:
table { table_name: "default.Table_6a76b7745ccc406facfc1fc1021b24d9" } new_table_name: "default.Table_9264d7b88c28449596f35c4e444713b8" modify_external_catalogs: true
I20260619 13:50:44.022771 1185 tablet_service.cc:1511] Processing CreateTablet for tablet 0e3a389b382e44299fb9a88d0d28cd1a (DEFAULT_TABLE table=default.table_2138876d1fe74e81bfc560e2fb592a0e [id=57c8bf0937b84407ace807934df053c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:44.024394 1184 tablet_service.cc:1511] Processing CreateTablet for tablet f2f0f4c1f6d94839ada7c9951b0ef7bc (DEFAULT_TABLE table=default.table_6a76b7745ccc406facfc1fc1021b24d9 [id=d0fb54a9a55b4a3b83f7c809ef7d24ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:44.026142 1184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2f0f4c1f6d94839ada7c9951b0ef7bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:44.031554 1185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e3a389b382e44299fb9a88d0d28cd1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:44.040313 1047 tablet_service.cc:1511] Processing CreateTablet for tablet f2f0f4c1f6d94839ada7c9951b0ef7bc (DEFAULT_TABLE table=default.table_6a76b7745ccc406facfc1fc1021b24d9 [id=d0fb54a9a55b4a3b83f7c809ef7d24ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:44.041754 1048 tablet_service.cc:1511] Processing CreateTablet for tablet 0e3a389b382e44299fb9a88d0d28cd1a (DEFAULT_TABLE table=default.table_2138876d1fe74e81bfc560e2fb592a0e [id=57c8bf0937b84407ace807934df053c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:44.042640 1048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e3a389b382e44299fb9a88d0d28cd1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:44.046914 1047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2f0f4c1f6d94839ada7c9951b0ef7bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:44.052328 876 catalog_manager.cc:2199] created HMS catalog entry for table [id=c250a119cf6642b2ad489636485fceac]
I20260619 13:50:44.062881 876 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49906:
table { table_name: "default.Table_75fff73b19164084879700104d9a214c" } new_table_name: "default.Table_f424e0ef22ac4d4492d2ca6a9b24d277" modify_external_catalogs: true
I20260619 13:50:44.068424 1322 tablet_service.cc:1511] Processing CreateTablet for tablet f2f0f4c1f6d94839ada7c9951b0ef7bc (DEFAULT_TABLE table=default.table_6a76b7745ccc406facfc1fc1021b24d9 [id=d0fb54a9a55b4a3b83f7c809ef7d24ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:44.070262 1322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2f0f4c1f6d94839ada7c9951b0ef7bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:44.080017 1321 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd56579c7a44155a0090e2720566a58 (DEFAULT_TABLE table=default.table_75fff73b19164084879700104d9a214c [id=c250a119cf6642b2ad489636485fceac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:44.080593 1321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd56579c7a44155a0090e2720566a58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:44.083586 1323 tablet_service.cc:1511] Processing CreateTablet for tablet 0e3a389b382e44299fb9a88d0d28cd1a (DEFAULT_TABLE table=default.table_2138876d1fe74e81bfc560e2fb592a0e [id=57c8bf0937b84407ace807934df053c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:44.084344 1323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e3a389b382e44299fb9a88d0d28cd1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:44.089922 1185 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd56579c7a44155a0090e2720566a58 (DEFAULT_TABLE table=default.table_75fff73b19164084879700104d9a214c [id=c250a119cf6642b2ad489636485fceac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:44.090526 1185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd56579c7a44155a0090e2720566a58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:44.104264 1461 tablet_bootstrap.cc:492] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 94599283b9334819b3bbe25509b7cd16: Bootstrap starting.
I20260619 13:50:44.105825 1462 tablet_bootstrap.cc:492] T 0e3a389b382e44299fb9a88d0d28cd1a P 380c26fd105f454cbe8ef6b87e35f41f: Bootstrap starting.
I20260619 13:50:44.110693 1463 tablet_bootstrap.cc:492] T 0e3a389b382e44299fb9a88d0d28cd1a P d54f30d62f034b35a8e73ff525ba43d9: Bootstrap starting.
I20260619 13:50:44.111707 1047 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd56579c7a44155a0090e2720566a58 (DEFAULT_TABLE table=default.table_75fff73b19164084879700104d9a214c [id=c250a119cf6642b2ad489636485fceac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:44.112188 1047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd56579c7a44155a0090e2720566a58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:44.117717 1463 tablet_bootstrap.cc:654] T 0e3a389b382e44299fb9a88d0d28cd1a P d54f30d62f034b35a8e73ff525ba43d9: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:44.119580 1462 tablet_bootstrap.cc:654] T 0e3a389b382e44299fb9a88d0d28cd1a P 380c26fd105f454cbe8ef6b87e35f41f: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:44.120056 1461 tablet_bootstrap.cc:654] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 94599283b9334819b3bbe25509b7cd16: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:44.121620 1461 log.cc:826] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 94599283b9334819b3bbe25509b7cd16: Log is configured to *not* fsync() on all Append() calls
I20260619 13:50:44.123075 1462 log.cc:826] T 0e3a389b382e44299fb9a88d0d28cd1a P 380c26fd105f454cbe8ef6b87e35f41f: Log is configured to *not* fsync() on all Append() calls
I20260619 13:50:44.124956 1463 log.cc:826] T 0e3a389b382e44299fb9a88d0d28cd1a P d54f30d62f034b35a8e73ff525ba43d9: Log is configured to *not* fsync() on all Append() calls
I20260619 13:50:44.145588 873 catalog_manager.cc:2199] created HMS catalog entry for table [id=2d3dc93800df4ce7bcaa51ca2d5172eb]
I20260619 13:50:44.149977 1463 tablet_bootstrap.cc:492] T 0e3a389b382e44299fb9a88d0d28cd1a P d54f30d62f034b35a8e73ff525ba43d9: No bootstrap required, opened a new log
I20260619 13:50:44.150305 1463 ts_tablet_manager.cc:1403] T 0e3a389b382e44299fb9a88d0d28cd1a P d54f30d62f034b35a8e73ff525ba43d9: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.005s
I20260619 13:50:44.153187 873 master_service.cc:960] ReplaceTablet: received request to replace tablet f2f0f4c1f6d94839ada7c9951b0ef7bc from {username='slave'} at 127.0.0.1:49906
I20260619 13:50:44.158018 1462 tablet_bootstrap.cc:492] T 0e3a389b382e44299fb9a88d0d28cd1a P 380c26fd105f454cbe8ef6b87e35f41f: No bootstrap required, opened a new log
I20260619 13:50:44.158345 1462 ts_tablet_manager.cc:1403] T 0e3a389b382e44299fb9a88d0d28cd1a P 380c26fd105f454cbe8ef6b87e35f41f: Time spent bootstrapping tablet: real 0.053s user 0.006s sys 0.003s
I20260619 13:50:44.157425 1463 raft_consensus.cc:359] T 0e3a389b382e44299fb9a88d0d28cd1a P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } }
I20260619 13:50:44.160537 1463 raft_consensus.cc:385] T 0e3a389b382e44299fb9a88d0d28cd1a P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:44.160660 1463 raft_consensus.cc:740] T 0e3a389b382e44299fb9a88d0d28cd1a P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f30d62f034b35a8e73ff525ba43d9, State: Initialized, Role: FOLLOWER
I20260619 13:50:44.161399 1463 consensus_queue.cc:260] T 0e3a389b382e44299fb9a88d0d28cd1a P d54f30d62f034b35a8e73ff525ba43d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } }
I20260619 13:50:44.165375 1462 raft_consensus.cc:359] T 0e3a389b382e44299fb9a88d0d28cd1a P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } }
I20260619 13:50:44.165668 873 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: Sending DeleteTablet for 3 replicas of tablet f2f0f4c1f6d94839ada7c9951b0ef7bc
I20260619 13:50:44.165848 1462 raft_consensus.cc:385] T 0e3a389b382e44299fb9a88d0d28cd1a P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:44.165947 1462 raft_consensus.cc:740] T 0e3a389b382e44299fb9a88d0d28cd1a P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 380c26fd105f454cbe8ef6b87e35f41f, State: Initialized, Role: FOLLOWER
I20260619 13:50:44.166806 1462 consensus_queue.cc:260] T 0e3a389b382e44299fb9a88d0d28cd1a P 380c26fd105f454cbe8ef6b87e35f41f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } }
I20260619 13:50:44.167927 1388 heartbeater.cc:499] Master 127.0.105.124:40279 was elected leader, sending a full tablet report...
I20260619 13:50:44.169869 1047 tablet_service.cc:1558] Processing DeleteTablet for tablet f2f0f4c1f6d94839ada7c9951b0ef7bc with delete_type TABLET_DATA_DELETED (replaced by tablet c8d8f0fa96f04d2b9dd9e4a3e7c97041) from {username='slave'} at 127.0.0.1:47424
I20260619 13:50:44.169930 1185 tablet_service.cc:1558] Processing DeleteTablet for tablet f2f0f4c1f6d94839ada7c9951b0ef7bc with delete_type TABLET_DATA_DELETED (replaced by tablet c8d8f0fa96f04d2b9dd9e4a3e7c97041) from {username='slave'} at 127.0.0.1:34286
I20260619 13:50:44.171602 1463 ts_tablet_manager.cc:1434] T 0e3a389b382e44299fb9a88d0d28cd1a P d54f30d62f034b35a8e73ff525ba43d9: Time spent starting tablet: real 0.021s user 0.008s sys 0.002s
I20260619 13:50:44.172091 1463 tablet_bootstrap.cc:492] T f2f0f4c1f6d94839ada7c9951b0ef7bc P d54f30d62f034b35a8e73ff525ba43d9: Bootstrap starting.
I20260619 13:50:44.172775 873 catalog_manager.cc:6784] ReplaceTablet: tablet f2f0f4c1f6d94839ada7c9951b0ef7bc deleted and replaced by tablet c8d8f0fa96f04d2b9dd9e4a3e7c97041
I20260619 13:50:44.173703 873 master_service.cc:960] ReplaceTablet: received request to replace tablet f2f0f4c1f6d94839ada7c9951b0ef7bc from {username='slave'} at 127.0.0.1:49906
I20260619 13:50:44.174045 1463 tablet_bootstrap.cc:654] T f2f0f4c1f6d94839ada7c9951b0ef7bc P d54f30d62f034b35a8e73ff525ba43d9: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:44.174012 1322 tablet_service.cc:1558] Processing DeleteTablet for tablet f2f0f4c1f6d94839ada7c9951b0ef7bc with delete_type TABLET_DATA_DELETED (replaced by tablet c8d8f0fa96f04d2b9dd9e4a3e7c97041) from {username='slave'} at 127.0.0.1:45026
W20260619 13:50:44.181524 864 catalog_manager.cc:5007] TS d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): delete failed for tablet f2f0f4c1f6d94839ada7c9951b0ef7bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2f0f4c1f6d94839ada7c9951b0ef7bc already in progress: creating tablet
I20260619 13:50:44.186086 1463 tablet_bootstrap.cc:492] T f2f0f4c1f6d94839ada7c9951b0ef7bc P d54f30d62f034b35a8e73ff525ba43d9: No bootstrap required, opened a new log
I20260619 13:50:44.186282 1463 ts_tablet_manager.cc:1403] T f2f0f4c1f6d94839ada7c9951b0ef7bc P d54f30d62f034b35a8e73ff525ba43d9: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.009s
I20260619 13:50:44.186370 1322 tablet_service.cc:1511] Processing CreateTablet for tablet d66b1eaa29454bb3bc8e2c493d01cb43 (DEFAULT_TABLE table=default.table_1623c8da7f1e42958362607cf3bed6f0 [id=2d3dc93800df4ce7bcaa51ca2d5172eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:44.186705 1184 tablet_service.cc:1511] Processing CreateTablet for tablet d66b1eaa29454bb3bc8e2c493d01cb43 (DEFAULT_TABLE table=default.table_1623c8da7f1e42958362607cf3bed6f0 [id=2d3dc93800df4ce7bcaa51ca2d5172eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:44.186894 1322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d66b1eaa29454bb3bc8e2c493d01cb43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:44.187104 1184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d66b1eaa29454bb3bc8e2c493d01cb43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:44.187363 1463 raft_consensus.cc:359] T f2f0f4c1f6d94839ada7c9951b0ef7bc P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.187572 1463 raft_consensus.cc:385] T f2f0f4c1f6d94839ada7c9951b0ef7bc P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:44.187669 1463 raft_consensus.cc:740] T f2f0f4c1f6d94839ada7c9951b0ef7bc P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f30d62f034b35a8e73ff525ba43d9, State: Initialized, Role: FOLLOWER
I20260619 13:50:44.187932 1463 consensus_queue.cc:260] T f2f0f4c1f6d94839ada7c9951b0ef7bc P d54f30d62f034b35a8e73ff525ba43d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.196013 1048 tablet_service.cc:1511] Processing CreateTablet for tablet d66b1eaa29454bb3bc8e2c493d01cb43 (DEFAULT_TABLE table=default.table_1623c8da7f1e42958362607cf3bed6f0 [id=2d3dc93800df4ce7bcaa51ca2d5172eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:44.196693 1048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d66b1eaa29454bb3bc8e2c493d01cb43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:44.233748 1322 tablet_service.cc:1558] Processing DeleteTablet for tablet f2f0f4c1f6d94839ada7c9951b0ef7bc with delete_type TABLET_DATA_DELETED (replaced by tablet c8d8f0fa96f04d2b9dd9e4a3e7c97041) from {username='slave'} at 127.0.0.1:45026
W20260619 13:50:44.234607 864 catalog_manager.cc:5007] TS d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): delete failed for tablet f2f0f4c1f6d94839ada7c9951b0ef7bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2f0f4c1f6d94839ada7c9951b0ef7bc already in progress: creating tablet
I20260619 13:50:44.244016 1184 tablet_service.cc:1511] Processing CreateTablet for tablet c8d8f0fa96f04d2b9dd9e4a3e7c97041 (DEFAULT_TABLE table=default.table_6a76b7745ccc406facfc1fc1021b24d9 [id=d0fb54a9a55b4a3b83f7c809ef7d24ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:44.244037 1046 tablet_service.cc:1511] Processing CreateTablet for tablet c8d8f0fa96f04d2b9dd9e4a3e7c97041 (DEFAULT_TABLE table=default.table_6a76b7745ccc406facfc1fc1021b24d9 [id=d0fb54a9a55b4a3b83f7c809ef7d24ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:44.244589 1184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8d8f0fa96f04d2b9dd9e4a3e7c97041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:44.244596 1046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8d8f0fa96f04d2b9dd9e4a3e7c97041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:44.249946 1322 tablet_service.cc:1511] Processing CreateTablet for tablet c8d8f0fa96f04d2b9dd9e4a3e7c97041 (DEFAULT_TABLE table=default.table_6a76b7745ccc406facfc1fc1021b24d9 [id=d0fb54a9a55b4a3b83f7c809ef7d24ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:44.250413 1322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8d8f0fa96f04d2b9dd9e4a3e7c97041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:44.253733 1321 tablet_service.cc:1558] Processing DeleteTablet for tablet f2f0f4c1f6d94839ada7c9951b0ef7bc with delete_type TABLET_DATA_DELETED (replaced by tablet c8d8f0fa96f04d2b9dd9e4a3e7c97041) from {username='slave'} at 127.0.0.1:45026
W20260619 13:50:44.254451 864 catalog_manager.cc:5007] TS d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): delete failed for tablet f2f0f4c1f6d94839ada7c9951b0ef7bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2f0f4c1f6d94839ada7c9951b0ef7bc already in progress: creating tablet
I20260619 13:50:44.254967 873 master_service.cc:960] ReplaceTablet: received request to replace tablet 0e3a389b382e44299fb9a88d0d28cd1a from {username='slave'} at 127.0.0.1:49906
I20260619 13:50:44.256851 1461 tablet_bootstrap.cc:492] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 94599283b9334819b3bbe25509b7cd16: No bootstrap required, opened a new log
I20260619 13:50:44.257177 1461 ts_tablet_manager.cc:1403] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 94599283b9334819b3bbe25509b7cd16: Time spent bootstrapping tablet: real 0.153s user 0.005s sys 0.005s
W20260619 13:50:44.264139 862 catalog_manager.cc:5007] TS 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): delete failed for tablet f2f0f4c1f6d94839ada7c9951b0ef7bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2f0f4c1f6d94839ada7c9951b0ef7bc already in progress: creating tablet
I20260619 13:50:44.264782 868 catalog_manager.cc:2199] created HMS catalog entry for table [id=9aea7bf089c54100afe5510f3b4ec4ae]
I20260619 13:50:44.273638 421 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
/tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.125:37003
--webserver_interface=127.0.105.125
--webserver_port=36357
--builtin_ntp_servers=127.0.105.84:41509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--hive_metastore_uris=thrift://127.0.0.1:39807
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260619 13:50:44.281353 868 master_service.cc:960] ReplaceTablet: received request to replace tablet f2f0f4c1f6d94839ada7c9951b0ef7bc from {username='slave'} at 127.0.0.1:49906
I20260619 13:50:44.281960 868 master_service.cc:960] ReplaceTablet: received request to replace tablet 0e3a389b382e44299fb9a88d0d28cd1a from {username='slave'} at 127.0.0.1:49906
I20260619 13:50:44.290534 868 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49906:
table { table_name: "default.Table_1623c8da7f1e42958362607cf3bed6f0" } new_table_name: "default.Table_5fdb6be1506543aab7b2548398b26c61" modify_external_catalogs: true
W20260619 13:50:44.302218 1391 tablet.cc:2406] T 0e3a389b382e44299fb9a88d0d28cd1a P d54f30d62f034b35a8e73ff525ba43d9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 13:50:44.304850 1046 tablet_service.cc:1511] Processing CreateTablet for tablet 81c901680eb84fe7ae5957ca045f2d69 (DEFAULT_TABLE table=default.table_c1ef2fe395ec45c98ee34472a137d486 [id=9aea7bf089c54100afe5510f3b4ec4ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:44.305341 1046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81c901680eb84fe7ae5957ca045f2d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:44.305609 1185 tablet_service.cc:1511] Processing CreateTablet for tablet 81c901680eb84fe7ae5957ca045f2d69 (DEFAULT_TABLE table=default.table_c1ef2fe395ec45c98ee34472a137d486 [id=9aea7bf089c54100afe5510f3b4ec4ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:44.306068 1185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81c901680eb84fe7ae5957ca045f2d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:44.310175 1322 tablet_service.cc:1511] Processing CreateTablet for tablet 81c901680eb84fe7ae5957ca045f2d69 (DEFAULT_TABLE table=default.table_c1ef2fe395ec45c98ee34472a137d486 [id=9aea7bf089c54100afe5510f3b4ec4ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:44.310653 1322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81c901680eb84fe7ae5957ca045f2d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:44.312515 873 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: Sending DeleteTablet for 3 replicas of tablet 0e3a389b382e44299fb9a88d0d28cd1a
I20260619 13:50:44.313625 1183 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e3a389b382e44299fb9a88d0d28cd1a with delete_type TABLET_DATA_DELETED (replaced by tablet 3491c8ba98ae45c1a6ba15a03d9d55f2) from {username='slave'} at 127.0.0.1:34286
I20260619 13:50:44.313961 1321 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e3a389b382e44299fb9a88d0d28cd1a with delete_type TABLET_DATA_DELETED (replaced by tablet 3491c8ba98ae45c1a6ba15a03d9d55f2) from {username='slave'} at 127.0.0.1:45026
I20260619 13:50:44.314038 1048 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e3a389b382e44299fb9a88d0d28cd1a with delete_type TABLET_DATA_DELETED (replaced by tablet 3491c8ba98ae45c1a6ba15a03d9d55f2) from {username='slave'} at 127.0.0.1:47424
I20260619 13:50:44.314328 1471 tablet_replica.cc:333] T 0e3a389b382e44299fb9a88d0d28cd1a P d54f30d62f034b35a8e73ff525ba43d9: stopping tablet replica
I20260619 13:50:44.314845 1471 raft_consensus.cc:2243] T 0e3a389b382e44299fb9a88d0d28cd1a P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 13:50:44.315279 1471 raft_consensus.cc:2272] T 0e3a389b382e44299fb9a88d0d28cd1a P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 13:50:44.317437 1471 ts_tablet_manager.cc:1916] T 0e3a389b382e44299fb9a88d0d28cd1a P d54f30d62f034b35a8e73ff525ba43d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 13:50:44.324440 1183 tablet_service.cc:1511] Processing CreateTablet for tablet 3491c8ba98ae45c1a6ba15a03d9d55f2 (DEFAULT_TABLE table=default.table_2138876d1fe74e81bfc560e2fb592a0e [id=57c8bf0937b84407ace807934df053c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:44.325145 1183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3491c8ba98ae45c1a6ba15a03d9d55f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:44.327131 1471 ts_tablet_manager.cc:1929] T 0e3a389b382e44299fb9a88d0d28cd1a P d54f30d62f034b35a8e73ff525ba43d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260619 13:50:44.329893 862 catalog_manager.cc:5007] TS 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): delete failed for tablet 0e3a389b382e44299fb9a88d0d28cd1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e3a389b382e44299fb9a88d0d28cd1a already in progress: creating tablet
I20260619 13:50:44.335696 1046 tablet_service.cc:1511] Processing CreateTablet for tablet 3491c8ba98ae45c1a6ba15a03d9d55f2 (DEFAULT_TABLE table=default.table_2138876d1fe74e81bfc560e2fb592a0e [id=57c8bf0937b84407ace807934df053c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:44.336293 1046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3491c8ba98ae45c1a6ba15a03d9d55f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:44.341050 1471 log.cc:1199] T 0e3a389b382e44299fb9a88d0d28cd1a P d54f30d62f034b35a8e73ff525ba43d9: Deleting WAL directory at /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-2/wal/wals/0e3a389b382e44299fb9a88d0d28cd1a
I20260619 13:50:44.341748 1471 ts_tablet_manager.cc:1950] T 0e3a389b382e44299fb9a88d0d28cd1a P d54f30d62f034b35a8e73ff525ba43d9: Deleting consensus metadata
I20260619 13:50:44.335572 1322 tablet_service.cc:1511] Processing CreateTablet for tablet 3491c8ba98ae45c1a6ba15a03d9d55f2 (DEFAULT_TABLE table=default.table_2138876d1fe74e81bfc560e2fb592a0e [id=57c8bf0937b84407ace807934df053c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:44.343091 1322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3491c8ba98ae45c1a6ba15a03d9d55f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:44.344135 864 catalog_manager.cc:5027] TS d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): tablet 0e3a389b382e44299fb9a88d0d28cd1a (table default.table_2138876d1fe74e81bfc560e2fb592a0e [id=57c8bf0937b84407ace807934df053c4]) successfully deleted
I20260619 13:50:44.349298 873 catalog_manager.cc:6784] ReplaceTablet: tablet 0e3a389b382e44299fb9a88d0d28cd1a deleted and replaced by tablet 3491c8ba98ae45c1a6ba15a03d9d55f2
I20260619 13:50:44.350567 873 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49906:
name: "default.Table_93c2826cde41498d8b9d82f106824c41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 13:50:44.351177 863 catalog_manager.cc:5007] TS 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): delete failed for tablet f2f0f4c1f6d94839ada7c9951b0ef7bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2f0f4c1f6d94839ada7c9951b0ef7bc already in progress: creating tablet
W20260619 13:50:44.352236 863 catalog_manager.cc:5007] TS 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): delete failed for tablet 0e3a389b382e44299fb9a88d0d28cd1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e3a389b382e44299fb9a88d0d28cd1a already in progress: creating tablet
I20260619 13:50:44.359601 1463 ts_tablet_manager.cc:1434] T f2f0f4c1f6d94839ada7c9951b0ef7bc P d54f30d62f034b35a8e73ff525ba43d9: Time spent starting tablet: real 0.173s user 0.017s sys 0.038s
I20260619 13:50:44.362788 1463 tablet_bootstrap.cc:492] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9: Bootstrap starting.
I20260619 13:50:44.363121 1113 heartbeater.cc:499] Master 127.0.105.124:40279 was elected leader, sending a full tablet report...
I20260619 13:50:44.364632 1463 tablet_bootstrap.cc:654] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:44.366858 1462 ts_tablet_manager.cc:1434] T 0e3a389b382e44299fb9a88d0d28cd1a P 380c26fd105f454cbe8ef6b87e35f41f: Time spent starting tablet: real 0.208s user 0.023s sys 0.041s
I20260619 13:50:44.367324 1462 tablet_bootstrap.cc:492] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 380c26fd105f454cbe8ef6b87e35f41f: Bootstrap starting.
I20260619 13:50:44.369051 1462 tablet_bootstrap.cc:654] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 380c26fd105f454cbe8ef6b87e35f41f: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:44.371109 1463 tablet_bootstrap.cc:492] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9: No bootstrap required, opened a new log
I20260619 13:50:44.371309 1463 ts_tablet_manager.cc:1403] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260619 13:50:44.372062 1463 raft_consensus.cc:359] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.372263 1463 raft_consensus.cc:385] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:44.372339 1463 raft_consensus.cc:740] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f30d62f034b35a8e73ff525ba43d9, State: Initialized, Role: FOLLOWER
I20260619 13:50:44.372766 1463 consensus_queue.cc:260] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.373222 1463 ts_tablet_manager.cc:1434] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260619 13:50:44.375401 1463 tablet_bootstrap.cc:492] T d66b1eaa29454bb3bc8e2c493d01cb43 P d54f30d62f034b35a8e73ff525ba43d9: Bootstrap starting.
I20260619 13:50:44.378399 1461 raft_consensus.cc:359] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.379838 1463 tablet_bootstrap.cc:654] T d66b1eaa29454bb3bc8e2c493d01cb43 P d54f30d62f034b35a8e73ff525ba43d9: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:44.384213 1462 tablet_bootstrap.cc:492] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 380c26fd105f454cbe8ef6b87e35f41f: No bootstrap required, opened a new log
I20260619 13:50:44.384384 1462 ts_tablet_manager.cc:1403] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 380c26fd105f454cbe8ef6b87e35f41f: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.002s
I20260619 13:50:44.385411 1462 raft_consensus.cc:359] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.385632 1462 raft_consensus.cc:385] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:44.385736 1462 raft_consensus.cc:740] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 380c26fd105f454cbe8ef6b87e35f41f, State: Initialized, Role: FOLLOWER
I20260619 13:50:44.385998 1462 consensus_queue.cc:260] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 380c26fd105f454cbe8ef6b87e35f41f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.386508 1462 ts_tablet_manager.cc:1434] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 380c26fd105f454cbe8ef6b87e35f41f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 13:50:44.387300 1463 tablet_bootstrap.cc:492] T d66b1eaa29454bb3bc8e2c493d01cb43 P d54f30d62f034b35a8e73ff525ba43d9: No bootstrap required, opened a new log
I20260619 13:50:44.387451 1463 ts_tablet_manager.cc:1403] T d66b1eaa29454bb3bc8e2c493d01cb43 P d54f30d62f034b35a8e73ff525ba43d9: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.002s
I20260619 13:50:44.388326 1463 raft_consensus.cc:359] T d66b1eaa29454bb3bc8e2c493d01cb43 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.388531 1463 raft_consensus.cc:385] T d66b1eaa29454bb3bc8e2c493d01cb43 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:44.388623 1463 raft_consensus.cc:740] T d66b1eaa29454bb3bc8e2c493d01cb43 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f30d62f034b35a8e73ff525ba43d9, State: Initialized, Role: FOLLOWER
I20260619 13:50:44.388913 1463 consensus_queue.cc:260] T d66b1eaa29454bb3bc8e2c493d01cb43 P d54f30d62f034b35a8e73ff525ba43d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.391932 1462 tablet_bootstrap.cc:492] T 0fd56579c7a44155a0090e2720566a58 P 380c26fd105f454cbe8ef6b87e35f41f: Bootstrap starting.
I20260619 13:50:44.392380 1463 ts_tablet_manager.cc:1434] T d66b1eaa29454bb3bc8e2c493d01cb43 P d54f30d62f034b35a8e73ff525ba43d9: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260619 13:50:44.393723 1462 tablet_bootstrap.cc:654] T 0fd56579c7a44155a0090e2720566a58 P 380c26fd105f454cbe8ef6b87e35f41f: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:44.395290 1463 tablet_bootstrap.cc:492] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9: Bootstrap starting.
I20260619 13:50:44.396216 1461 raft_consensus.cc:385] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:44.396406 1461 raft_consensus.cc:740] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94599283b9334819b3bbe25509b7cd16, State: Initialized, Role: FOLLOWER
I20260619 13:50:44.396940 1463 tablet_bootstrap.cc:654] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:44.397421 1461 consensus_queue.cc:260] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 94599283b9334819b3bbe25509b7cd16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.400763 1250 heartbeater.cc:499] Master 127.0.105.124:40279 was elected leader, sending a full tablet report...
I20260619 13:50:44.403576 1461 ts_tablet_manager.cc:1434] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 94599283b9334819b3bbe25509b7cd16: Time spent starting tablet: real 0.146s user 0.009s sys 0.002s
I20260619 13:50:44.405036 1463 tablet_bootstrap.cc:492] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9: No bootstrap required, opened a new log
I20260619 13:50:44.405223 1463 ts_tablet_manager.cc:1403] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260619 13:50:44.406001 1463 raft_consensus.cc:359] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.406234 1463 raft_consensus.cc:385] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:44.406322 1463 raft_consensus.cc:740] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f30d62f034b35a8e73ff525ba43d9, State: Initialized, Role: FOLLOWER
I20260619 13:50:44.406517 1461 tablet_bootstrap.cc:492] T 0e3a389b382e44299fb9a88d0d28cd1a P 94599283b9334819b3bbe25509b7cd16: Bootstrap starting.
I20260619 13:50:44.406607 1463 consensus_queue.cc:260] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.411309 1461 tablet_bootstrap.cc:654] T 0e3a389b382e44299fb9a88d0d28cd1a P 94599283b9334819b3bbe25509b7cd16: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:44.415272 1462 tablet_bootstrap.cc:492] T 0fd56579c7a44155a0090e2720566a58 P 380c26fd105f454cbe8ef6b87e35f41f: No bootstrap required, opened a new log
I20260619 13:50:44.415540 1462 ts_tablet_manager.cc:1403] T 0fd56579c7a44155a0090e2720566a58 P 380c26fd105f454cbe8ef6b87e35f41f: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.005s
I20260619 13:50:44.415829 1463 ts_tablet_manager.cc:1434] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260619 13:50:44.416445 1462 raft_consensus.cc:359] T 0fd56579c7a44155a0090e2720566a58 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.416837 1462 raft_consensus.cc:385] T 0fd56579c7a44155a0090e2720566a58 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:44.416971 1462 raft_consensus.cc:740] T 0fd56579c7a44155a0090e2720566a58 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 380c26fd105f454cbe8ef6b87e35f41f, State: Initialized, Role: FOLLOWER
I20260619 13:50:44.417322 1462 consensus_queue.cc:260] T 0fd56579c7a44155a0090e2720566a58 P 380c26fd105f454cbe8ef6b87e35f41f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.419323 1463 tablet_bootstrap.cc:492] T 81c901680eb84fe7ae5957ca045f2d69 P d54f30d62f034b35a8e73ff525ba43d9: Bootstrap starting.
I20260619 13:50:44.420718 1462 ts_tablet_manager.cc:1434] T 0fd56579c7a44155a0090e2720566a58 P 380c26fd105f454cbe8ef6b87e35f41f: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260619 13:50:44.421105 1463 tablet_bootstrap.cc:654] T 81c901680eb84fe7ae5957ca045f2d69 P d54f30d62f034b35a8e73ff525ba43d9: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:44.423887 1462 tablet_bootstrap.cc:492] T d66b1eaa29454bb3bc8e2c493d01cb43 P 380c26fd105f454cbe8ef6b87e35f41f: Bootstrap starting.
I20260619 13:50:44.425693 1462 tablet_bootstrap.cc:654] T d66b1eaa29454bb3bc8e2c493d01cb43 P 380c26fd105f454cbe8ef6b87e35f41f: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:44.435935 1462 tablet_bootstrap.cc:492] T d66b1eaa29454bb3bc8e2c493d01cb43 P 380c26fd105f454cbe8ef6b87e35f41f: No bootstrap required, opened a new log
I20260619 13:50:44.436055 1461 tablet_bootstrap.cc:492] T 0e3a389b382e44299fb9a88d0d28cd1a P 94599283b9334819b3bbe25509b7cd16: No bootstrap required, opened a new log
I20260619 13:50:44.436247 1462 ts_tablet_manager.cc:1403] T d66b1eaa29454bb3bc8e2c493d01cb43 P 380c26fd105f454cbe8ef6b87e35f41f: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.004s
I20260619 13:50:44.436249 1461 ts_tablet_manager.cc:1403] T 0e3a389b382e44299fb9a88d0d28cd1a P 94599283b9334819b3bbe25509b7cd16: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.000s
I20260619 13:50:44.437166 1462 raft_consensus.cc:359] T d66b1eaa29454bb3bc8e2c493d01cb43 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.437450 1462 raft_consensus.cc:385] T d66b1eaa29454bb3bc8e2c493d01cb43 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:44.437651 1462 raft_consensus.cc:740] T d66b1eaa29454bb3bc8e2c493d01cb43 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 380c26fd105f454cbe8ef6b87e35f41f, State: Initialized, Role: FOLLOWER
I20260619 13:50:44.437592 1461 raft_consensus.cc:359] T 0e3a389b382e44299fb9a88d0d28cd1a P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } }
I20260619 13:50:44.437855 1461 raft_consensus.cc:385] T 0e3a389b382e44299fb9a88d0d28cd1a P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:44.437968 1461 raft_consensus.cc:740] T 0e3a389b382e44299fb9a88d0d28cd1a P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94599283b9334819b3bbe25509b7cd16, State: Initialized, Role: FOLLOWER
I20260619 13:50:44.438131 1462 consensus_queue.cc:260] T d66b1eaa29454bb3bc8e2c493d01cb43 P 380c26fd105f454cbe8ef6b87e35f41f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.438280 1461 consensus_queue.cc:260] T 0e3a389b382e44299fb9a88d0d28cd1a P 94599283b9334819b3bbe25509b7cd16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } }
I20260619 13:50:44.438968 1461 ts_tablet_manager.cc:1434] T 0e3a389b382e44299fb9a88d0d28cd1a P 94599283b9334819b3bbe25509b7cd16: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260619 13:50:44.439991 1461 tablet_bootstrap.cc:492] T 0fd56579c7a44155a0090e2720566a58 P 94599283b9334819b3bbe25509b7cd16: Bootstrap starting.
I20260619 13:50:44.441932 1462 ts_tablet_manager.cc:1434] T d66b1eaa29454bb3bc8e2c493d01cb43 P 380c26fd105f454cbe8ef6b87e35f41f: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260619 13:50:44.442728 1461 tablet_bootstrap.cc:654] T 0fd56579c7a44155a0090e2720566a58 P 94599283b9334819b3bbe25509b7cd16: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:44.444876 1462 tablet_bootstrap.cc:492] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f: Bootstrap starting.
I20260619 13:50:44.445046 1463 tablet_bootstrap.cc:492] T 81c901680eb84fe7ae5957ca045f2d69 P d54f30d62f034b35a8e73ff525ba43d9: No bootstrap required, opened a new log
I20260619 13:50:44.445227 1463 ts_tablet_manager.cc:1403] T 81c901680eb84fe7ae5957ca045f2d69 P d54f30d62f034b35a8e73ff525ba43d9: Time spent bootstrapping tablet: real 0.026s user 0.009s sys 0.011s
I20260619 13:50:44.446112 1463 raft_consensus.cc:359] T 81c901680eb84fe7ae5957ca045f2d69 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.446346 1463 raft_consensus.cc:385] T 81c901680eb84fe7ae5957ca045f2d69 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:44.446444 1463 raft_consensus.cc:740] T 81c901680eb84fe7ae5957ca045f2d69 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f30d62f034b35a8e73ff525ba43d9, State: Initialized, Role: FOLLOWER
I20260619 13:50:44.446725 1463 consensus_queue.cc:260] T 81c901680eb84fe7ae5957ca045f2d69 P d54f30d62f034b35a8e73ff525ba43d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.446928 1462 tablet_bootstrap.cc:654] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:44.450656 1463 ts_tablet_manager.cc:1434] T 81c901680eb84fe7ae5957ca045f2d69 P d54f30d62f034b35a8e73ff525ba43d9: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260619 13:50:44.453907 1463 tablet_bootstrap.cc:492] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P d54f30d62f034b35a8e73ff525ba43d9: Bootstrap starting.
I20260619 13:50:44.455775 1463 tablet_bootstrap.cc:654] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P d54f30d62f034b35a8e73ff525ba43d9: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:44.462422 1462 tablet_bootstrap.cc:492] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f: No bootstrap required, opened a new log
I20260619 13:50:44.462707 1462 ts_tablet_manager.cc:1403] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.000s
I20260619 13:50:44.463784 1462 raft_consensus.cc:359] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.463927 1463 tablet_bootstrap.cc:492] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P d54f30d62f034b35a8e73ff525ba43d9: No bootstrap required, opened a new log
I20260619 13:50:44.464085 1462 raft_consensus.cc:385] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:44.464118 1463 ts_tablet_manager.cc:1403] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P d54f30d62f034b35a8e73ff525ba43d9: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.008s
I20260619 13:50:44.464279 1462 raft_consensus.cc:740] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 380c26fd105f454cbe8ef6b87e35f41f, State: Initialized, Role: FOLLOWER
I20260619 13:50:44.464639 1462 consensus_queue.cc:260] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.464933 1463 raft_consensus.cc:359] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.465130 1463 raft_consensus.cc:385] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:44.465201 1463 raft_consensus.cc:740] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f30d62f034b35a8e73ff525ba43d9, State: Initialized, Role: FOLLOWER
I20260619 13:50:44.465480 1463 consensus_queue.cc:260] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P d54f30d62f034b35a8e73ff525ba43d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.468590 1462 ts_tablet_manager.cc:1434] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260619 13:50:44.469064 1463 ts_tablet_manager.cc:1434] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P d54f30d62f034b35a8e73ff525ba43d9: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260619 13:50:44.471709 1462 tablet_bootstrap.cc:492] T 81c901680eb84fe7ae5957ca045f2d69 P 380c26fd105f454cbe8ef6b87e35f41f: Bootstrap starting.
I20260619 13:50:44.473212 1461 tablet_bootstrap.cc:492] T 0fd56579c7a44155a0090e2720566a58 P 94599283b9334819b3bbe25509b7cd16: No bootstrap required, opened a new log
I20260619 13:50:44.473416 1461 ts_tablet_manager.cc:1403] T 0fd56579c7a44155a0090e2720566a58 P 94599283b9334819b3bbe25509b7cd16: Time spent bootstrapping tablet: real 0.033s user 0.000s sys 0.003s
I20260619 13:50:44.473845 1462 tablet_bootstrap.cc:654] T 81c901680eb84fe7ae5957ca045f2d69 P 380c26fd105f454cbe8ef6b87e35f41f: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:44.474282 1461 raft_consensus.cc:359] T 0fd56579c7a44155a0090e2720566a58 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.474507 1461 raft_consensus.cc:385] T 0fd56579c7a44155a0090e2720566a58 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:44.474601 1461 raft_consensus.cc:740] T 0fd56579c7a44155a0090e2720566a58 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94599283b9334819b3bbe25509b7cd16, State: Initialized, Role: FOLLOWER
I20260619 13:50:44.475039 1461 consensus_queue.cc:260] T 0fd56579c7a44155a0090e2720566a58 P 94599283b9334819b3bbe25509b7cd16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.475584 1461 ts_tablet_manager.cc:1434] T 0fd56579c7a44155a0090e2720566a58 P 94599283b9334819b3bbe25509b7cd16: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 13:50:44.475950 1461 tablet_bootstrap.cc:492] T d66b1eaa29454bb3bc8e2c493d01cb43 P 94599283b9334819b3bbe25509b7cd16: Bootstrap starting.
I20260619 13:50:44.480175 1473 raft_consensus.cc:493] T 81c901680eb84fe7ae5957ca045f2d69 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:50:44.480440 1473 raft_consensus.cc:515] T 81c901680eb84fe7ae5957ca045f2d69 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.482542 1473 leader_election.cc:290] T 81c901680eb84fe7ae5957ca045f2d69 P d54f30d62f034b35a8e73ff525ba43d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865)
W20260619 13:50:44.487149 1116 tablet.cc:2406] T 0e3a389b382e44299fb9a88d0d28cd1a P 380c26fd105f454cbe8ef6b87e35f41f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 13:50:44.490991 1462 tablet_bootstrap.cc:492] T 81c901680eb84fe7ae5957ca045f2d69 P 380c26fd105f454cbe8ef6b87e35f41f: No bootstrap required, opened a new log
I20260619 13:50:44.491268 1462 ts_tablet_manager.cc:1403] T 81c901680eb84fe7ae5957ca045f2d69 P 380c26fd105f454cbe8ef6b87e35f41f: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.005s
I20260619 13:50:44.492095 1462 raft_consensus.cc:359] T 81c901680eb84fe7ae5957ca045f2d69 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.492425 1462 raft_consensus.cc:385] T 81c901680eb84fe7ae5957ca045f2d69 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:44.492594 1462 raft_consensus.cc:740] T 81c901680eb84fe7ae5957ca045f2d69 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 380c26fd105f454cbe8ef6b87e35f41f, State: Initialized, Role: FOLLOWER
I20260619 13:50:44.492928 1462 consensus_queue.cc:260] T 81c901680eb84fe7ae5957ca045f2d69 P 380c26fd105f454cbe8ef6b87e35f41f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.493906 1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c901680eb84fe7ae5957ca045f2d69" candidate_uuid: "d54f30d62f034b35a8e73ff525ba43d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94599283b9334819b3bbe25509b7cd16" is_pre_election: true
W20260619 13:50:44.495194 1277 leader_election.cc:343] T 81c901680eb84fe7ae5957ca045f2d69 P d54f30d62f034b35a8e73ff525ba43d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Illegal state: must be running to vote when last-logged opid is not known
I20260619 13:50:44.495445 1461 tablet_bootstrap.cc:654] T d66b1eaa29454bb3bc8e2c493d01cb43 P 94599283b9334819b3bbe25509b7cd16: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:44.496842 1462 ts_tablet_manager.cc:1434] T 81c901680eb84fe7ae5957ca045f2d69 P 380c26fd105f454cbe8ef6b87e35f41f: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260619 13:50:44.499998 1462 tablet_bootstrap.cc:492] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 380c26fd105f454cbe8ef6b87e35f41f: Bootstrap starting.
I20260619 13:50:44.501778 1462 tablet_bootstrap.cc:654] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 380c26fd105f454cbe8ef6b87e35f41f: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:44.506789 1461 tablet_bootstrap.cc:492] T d66b1eaa29454bb3bc8e2c493d01cb43 P 94599283b9334819b3bbe25509b7cd16: No bootstrap required, opened a new log
I20260619 13:50:44.506983 1461 ts_tablet_manager.cc:1403] T d66b1eaa29454bb3bc8e2c493d01cb43 P 94599283b9334819b3bbe25509b7cd16: Time spent bootstrapping tablet: real 0.031s user 0.005s sys 0.000s
I20260619 13:50:44.507846 1461 raft_consensus.cc:359] T d66b1eaa29454bb3bc8e2c493d01cb43 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.508040 1461 raft_consensus.cc:385] T d66b1eaa29454bb3bc8e2c493d01cb43 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:44.508116 1461 raft_consensus.cc:740] T d66b1eaa29454bb3bc8e2c493d01cb43 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94599283b9334819b3bbe25509b7cd16, State: Initialized, Role: FOLLOWER
I20260619 13:50:44.508347 1461 consensus_queue.cc:260] T d66b1eaa29454bb3bc8e2c493d01cb43 P 94599283b9334819b3bbe25509b7cd16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.508842 1461 ts_tablet_manager.cc:1434] T d66b1eaa29454bb3bc8e2c493d01cb43 P 94599283b9334819b3bbe25509b7cd16: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 13:50:44.509115 1461 tablet_bootstrap.cc:492] T 81c901680eb84fe7ae5957ca045f2d69 P 94599283b9334819b3bbe25509b7cd16: Bootstrap starting.
I20260619 13:50:44.510957 1461 tablet_bootstrap.cc:654] T 81c901680eb84fe7ae5957ca045f2d69 P 94599283b9334819b3bbe25509b7cd16: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:44.518025 1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c901680eb84fe7ae5957ca045f2d69" candidate_uuid: "d54f30d62f034b35a8e73ff525ba43d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "380c26fd105f454cbe8ef6b87e35f41f" is_pre_election: true
I20260619 13:50:44.518559 1068 raft_consensus.cc:2468] T 81c901680eb84fe7ae5957ca045f2d69 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f30d62f034b35a8e73ff525ba43d9 in term 0.
I20260619 13:50:44.519326 1278 leader_election.cc:304] T 81c901680eb84fe7ae5957ca045f2d69 P d54f30d62f034b35a8e73ff525ba43d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f, d54f30d62f034b35a8e73ff525ba43d9; no voters: 94599283b9334819b3bbe25509b7cd16
I20260619 13:50:44.520074 1473 raft_consensus.cc:2804] T 81c901680eb84fe7ae5957ca045f2d69 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 13:50:44.520210 1473 raft_consensus.cc:493] T 81c901680eb84fe7ae5957ca045f2d69 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 13:50:44.520298 1473 raft_consensus.cc:3060] T 81c901680eb84fe7ae5957ca045f2d69 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:44.523276 1473 raft_consensus.cc:515] T 81c901680eb84fe7ae5957ca045f2d69 P d54f30d62f034b35a8e73ff525ba43d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.524420 1473 leader_election.cc:290] T 81c901680eb84fe7ae5957ca045f2d69 P d54f30d62f034b35a8e73ff525ba43d9 [CANDIDATE]: Term 1 election: Requested vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865)
I20260619 13:50:44.524502 1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c901680eb84fe7ae5957ca045f2d69" candidate_uuid: "d54f30d62f034b35a8e73ff525ba43d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94599283b9334819b3bbe25509b7cd16"
I20260619 13:50:44.525163 1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c901680eb84fe7ae5957ca045f2d69" candidate_uuid: "d54f30d62f034b35a8e73ff525ba43d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "380c26fd105f454cbe8ef6b87e35f41f"
I20260619 13:50:44.525362 1068 raft_consensus.cc:3060] T 81c901680eb84fe7ae5957ca045f2d69 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Advancing to term 1
W20260619 13:50:44.529887 1277 leader_election.cc:343] T 81c901680eb84fe7ae5957ca045f2d69 P d54f30d62f034b35a8e73ff525ba43d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Illegal state: must be running to vote when last-logged opid is not known
I20260619 13:50:44.530236 1068 raft_consensus.cc:2468] T 81c901680eb84fe7ae5957ca045f2d69 P 380c26fd105f454cbe8ef6b87e35f41f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f30d62f034b35a8e73ff525ba43d9 in term 1.
I20260619 13:50:44.530907 1278 leader_election.cc:304] T 81c901680eb84fe7ae5957ca045f2d69 P d54f30d62f034b35a8e73ff525ba43d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f, d54f30d62f034b35a8e73ff525ba43d9; no voters: 94599283b9334819b3bbe25509b7cd16
I20260619 13:50:44.531599 1473 raft_consensus.cc:2804] T 81c901680eb84fe7ae5957ca045f2d69 P d54f30d62f034b35a8e73ff525ba43d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 13:50:44.531876 1473 raft_consensus.cc:697] T 81c901680eb84fe7ae5957ca045f2d69 P d54f30d62f034b35a8e73ff525ba43d9 [term 1 LEADER]: Becoming Leader. State: Replica: d54f30d62f034b35a8e73ff525ba43d9, State: Running, Role: LEADER
I20260619 13:50:44.533099 1473 consensus_queue.cc:237] T 81c901680eb84fe7ae5957ca045f2d69 P d54f30d62f034b35a8e73ff525ba43d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
W20260619 13:50:44.535557 1253 tablet.cc:2406] T 0e3a389b382e44299fb9a88d0d28cd1a P 94599283b9334819b3bbe25509b7cd16: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 13:50:44.551273 1462 tablet_bootstrap.cc:492] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 380c26fd105f454cbe8ef6b87e35f41f: No bootstrap required, opened a new log
I20260619 13:50:44.551545 1462 ts_tablet_manager.cc:1403] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 380c26fd105f454cbe8ef6b87e35f41f: Time spent bootstrapping tablet: real 0.052s user 0.001s sys 0.005s
I20260619 13:50:44.552490 1462 raft_consensus.cc:359] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.552798 1462 raft_consensus.cc:385] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:44.552929 1462 raft_consensus.cc:740] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 380c26fd105f454cbe8ef6b87e35f41f, State: Initialized, Role: FOLLOWER
I20260619 13:50:44.553288 1462 consensus_queue.cc:260] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 380c26fd105f454cbe8ef6b87e35f41f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.557152 1468 raft_consensus.cc:493] T d66b1eaa29454bb3bc8e2c493d01cb43 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:50:44.557317 1468 raft_consensus.cc:515] T d66b1eaa29454bb3bc8e2c493d01cb43 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.559252 1468 leader_election.cc:290] T d66b1eaa29454bb3bc8e2c493d01cb43 P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
I20260619 13:50:44.569440 1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66b1eaa29454bb3bc8e2c493d01cb43" candidate_uuid: "380c26fd105f454cbe8ef6b87e35f41f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94599283b9334819b3bbe25509b7cd16" is_pre_election: true
I20260619 13:50:44.569864 1205 raft_consensus.cc:2468] T d66b1eaa29454bb3bc8e2c493d01cb43 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 380c26fd105f454cbe8ef6b87e35f41f in term 0.
I20260619 13:50:44.570624 1002 leader_election.cc:304] T d66b1eaa29454bb3bc8e2c493d01cb43 P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f, 94599283b9334819b3bbe25509b7cd16; no voters:
I20260619 13:50:44.571213 1468 raft_consensus.cc:2804] T d66b1eaa29454bb3bc8e2c493d01cb43 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 13:50:44.571341 1468 raft_consensus.cc:493] T d66b1eaa29454bb3bc8e2c493d01cb43 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 13:50:44.571425 1468 raft_consensus.cc:3060] T d66b1eaa29454bb3bc8e2c493d01cb43 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:44.575138 1468 raft_consensus.cc:515] T d66b1eaa29454bb3bc8e2c493d01cb43 P 380c26fd105f454cbe8ef6b87e35f41f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.576601 1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66b1eaa29454bb3bc8e2c493d01cb43" candidate_uuid: "380c26fd105f454cbe8ef6b87e35f41f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94599283b9334819b3bbe25509b7cd16"
I20260619 13:50:44.576817 1205 raft_consensus.cc:3060] T d66b1eaa29454bb3bc8e2c493d01cb43 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:44.579900 1205 raft_consensus.cc:2468] T d66b1eaa29454bb3bc8e2c493d01cb43 P 94599283b9334819b3bbe25509b7cd16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 380c26fd105f454cbe8ef6b87e35f41f in term 1.
I20260619 13:50:44.580489 1002 leader_election.cc:304] T d66b1eaa29454bb3bc8e2c493d01cb43 P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f, 94599283b9334819b3bbe25509b7cd16; no voters:
I20260619 13:50:44.580866 1462 ts_tablet_manager.cc:1434] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 380c26fd105f454cbe8ef6b87e35f41f: Time spent starting tablet: real 0.029s user 0.002s sys 0.000s
I20260619 13:50:44.585366 1468 leader_election.cc:290] T d66b1eaa29454bb3bc8e2c493d01cb43 P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 election: Requested vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
I20260619 13:50:44.586143 1468 raft_consensus.cc:2804] T d66b1eaa29454bb3bc8e2c493d01cb43 P 380c26fd105f454cbe8ef6b87e35f41f [term 1 FOLLOWER]: Leader election won for term 1
I20260619 13:50:44.586421 1473 raft_consensus.cc:493] T d66b1eaa29454bb3bc8e2c493d01cb43 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:50:44.586674 1473 raft_consensus.cc:515] T d66b1eaa29454bb3bc8e2c493d01cb43 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.587668 1461 tablet_bootstrap.cc:492] T 81c901680eb84fe7ae5957ca045f2d69 P 94599283b9334819b3bbe25509b7cd16: No bootstrap required, opened a new log
I20260619 13:50:44.587819 1473 leader_election.cc:290] T d66b1eaa29454bb3bc8e2c493d01cb43 P d54f30d62f034b35a8e73ff525ba43d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865), 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481)
I20260619 13:50:44.587868 1461 ts_tablet_manager.cc:1403] T 81c901680eb84fe7ae5957ca045f2d69 P 94599283b9334819b3bbe25509b7cd16: Time spent bootstrapping tablet: real 0.079s user 0.006s sys 0.012s
I20260619 13:50:44.588229 1468 raft_consensus.cc:697] T d66b1eaa29454bb3bc8e2c493d01cb43 P 380c26fd105f454cbe8ef6b87e35f41f [term 1 LEADER]: Becoming Leader. State: Replica: 380c26fd105f454cbe8ef6b87e35f41f, State: Running, Role: LEADER
I20260619 13:50:44.588709 1461 raft_consensus.cc:359] T 81c901680eb84fe7ae5957ca045f2d69 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.588760 1468 consensus_queue.cc:237] T d66b1eaa29454bb3bc8e2c493d01cb43 P 380c26fd105f454cbe8ef6b87e35f41f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.588904 1461 raft_consensus.cc:385] T 81c901680eb84fe7ae5957ca045f2d69 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:44.588964 1461 raft_consensus.cc:740] T 81c901680eb84fe7ae5957ca045f2d69 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94599283b9334819b3bbe25509b7cd16, State: Initialized, Role: FOLLOWER
I20260619 13:50:44.589226 1461 consensus_queue.cc:260] T 81c901680eb84fe7ae5957ca045f2d69 P 94599283b9334819b3bbe25509b7cd16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.589819 1461 ts_tablet_manager.cc:1434] T 81c901680eb84fe7ae5957ca045f2d69 P 94599283b9334819b3bbe25509b7cd16: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 13:50:44.590118 1461 tablet_bootstrap.cc:492] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16: Bootstrap starting.
I20260619 13:50:44.592895 1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66b1eaa29454bb3bc8e2c493d01cb43" candidate_uuid: "d54f30d62f034b35a8e73ff525ba43d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94599283b9334819b3bbe25509b7cd16" is_pre_election: true
I20260619 13:50:44.593202 1205 raft_consensus.cc:2393] T d66b1eaa29454bb3bc8e2c493d01cb43 P 94599283b9334819b3bbe25509b7cd16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d54f30d62f034b35a8e73ff525ba43d9 in current term 1: Already voted for candidate 380c26fd105f454cbe8ef6b87e35f41f in this term.
I20260619 13:50:44.594072 1461 tablet_bootstrap.cc:654] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:44.601480 1461 tablet_bootstrap.cc:492] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16: No bootstrap required, opened a new log
I20260619 13:50:44.601686 1461 ts_tablet_manager.cc:1403] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.002s
I20260619 13:50:44.602484 1461 raft_consensus.cc:359] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.602715 1461 raft_consensus.cc:385] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:44.602816 1461 raft_consensus.cc:740] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94599283b9334819b3bbe25509b7cd16, State: Initialized, Role: FOLLOWER
I20260619 13:50:44.603091 1461 consensus_queue.cc:260] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.605384 1461 ts_tablet_manager.cc:1434] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260619 13:50:44.607004 1461 tablet_bootstrap.cc:492] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 94599283b9334819b3bbe25509b7cd16: Bootstrap starting.
I20260619 13:50:44.606961 1342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66b1eaa29454bb3bc8e2c493d01cb43" candidate_uuid: "380c26fd105f454cbe8ef6b87e35f41f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f30d62f034b35a8e73ff525ba43d9"
I20260619 13:50:44.607056 1343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66b1eaa29454bb3bc8e2c493d01cb43" candidate_uuid: "380c26fd105f454cbe8ef6b87e35f41f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f30d62f034b35a8e73ff525ba43d9" is_pre_election: true
I20260619 13:50:44.607409 1343 raft_consensus.cc:2468] T d66b1eaa29454bb3bc8e2c493d01cb43 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 380c26fd105f454cbe8ef6b87e35f41f in term 0.
I20260619 13:50:44.611532 1461 tablet_bootstrap.cc:654] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 94599283b9334819b3bbe25509b7cd16: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:44.612725 1497 raft_consensus.cc:493] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:50:44.613310 1497 raft_consensus.cc:515] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.617547 1342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d8f0fa96f04d2b9dd9e4a3e7c97041" candidate_uuid: "380c26fd105f454cbe8ef6b87e35f41f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f30d62f034b35a8e73ff525ba43d9" is_pre_election: true
I20260619 13:50:44.617872 1342 raft_consensus.cc:2468] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 380c26fd105f454cbe8ef6b87e35f41f in term 0.
I20260619 13:50:44.618618 1004 leader_election.cc:304] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f, d54f30d62f034b35a8e73ff525ba43d9; no voters:
I20260619 13:50:44.619030 1497 leader_election.cc:290] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
I20260619 13:50:44.619516 1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d66b1eaa29454bb3bc8e2c493d01cb43" candidate_uuid: "d54f30d62f034b35a8e73ff525ba43d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "380c26fd105f454cbe8ef6b87e35f41f" is_pre_election: true
I20260619 13:50:44.620752 1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d8f0fa96f04d2b9dd9e4a3e7c97041" candidate_uuid: "380c26fd105f454cbe8ef6b87e35f41f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94599283b9334819b3bbe25509b7cd16" is_pre_election: true
I20260619 13:50:44.621593 1278 leader_election.cc:304] T d66b1eaa29454bb3bc8e2c493d01cb43 P d54f30d62f034b35a8e73ff525ba43d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d54f30d62f034b35a8e73ff525ba43d9; no voters: 380c26fd105f454cbe8ef6b87e35f41f, 94599283b9334819b3bbe25509b7cd16
I20260619 13:50:44.621727 1461 tablet_bootstrap.cc:492] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 94599283b9334819b3bbe25509b7cd16: No bootstrap required, opened a new log
I20260619 13:50:44.621881 1461 ts_tablet_manager.cc:1403] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 94599283b9334819b3bbe25509b7cd16: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.002s
I20260619 13:50:44.622241 1473 raft_consensus.cc:3060] T d66b1eaa29454bb3bc8e2c493d01cb43 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:44.622745 1461 raft_consensus.cc:359] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.622932 1461 raft_consensus.cc:385] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:44.622993 1461 raft_consensus.cc:740] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94599283b9334819b3bbe25509b7cd16, State: Initialized, Role: FOLLOWER
I20260619 13:50:44.623320 1461 consensus_queue.cc:260] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 94599283b9334819b3bbe25509b7cd16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.623920 1461 ts_tablet_manager.cc:1434] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 94599283b9334819b3bbe25509b7cd16: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 13:50:44.628763 1473 raft_consensus.cc:2749] T d66b1eaa29454bb3bc8e2c493d01cb43 P d54f30d62f034b35a8e73ff525ba43d9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 13:50:44.629339 1002 leader_election.cc:343] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Illegal state: must be running to vote when last-logged opid is not known
I20260619 13:50:44.619069 1500 raft_consensus.cc:2804] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 13:50:44.629830 1500 raft_consensus.cc:493] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 13:50:44.629990 1500 raft_consensus.cc:3060] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:44.631983 1500 raft_consensus.cc:515] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.633165 1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d8f0fa96f04d2b9dd9e4a3e7c97041" candidate_uuid: "380c26fd105f454cbe8ef6b87e35f41f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94599283b9334819b3bbe25509b7cd16"
I20260619 13:50:44.633147 1342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d8f0fa96f04d2b9dd9e4a3e7c97041" candidate_uuid: "380c26fd105f454cbe8ef6b87e35f41f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f30d62f034b35a8e73ff525ba43d9"
I20260619 13:50:44.633353 1205 raft_consensus.cc:3060] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:44.633373 1342 raft_consensus.cc:3060] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:44.636222 1205 raft_consensus.cc:2468] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 94599283b9334819b3bbe25509b7cd16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 380c26fd105f454cbe8ef6b87e35f41f in term 1.
I20260619 13:50:44.636209 1342 raft_consensus.cc:2468] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 380c26fd105f454cbe8ef6b87e35f41f in term 1.
I20260619 13:50:44.636834 1004 leader_election.cc:304] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f, d54f30d62f034b35a8e73ff525ba43d9; no voters:
I20260619 13:50:44.637159 1500 leader_election.cc:290] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 election: Requested vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
I20260619 13:50:44.637207 1497 raft_consensus.cc:2804] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f [term 1 FOLLOWER]: Leader election won for term 1
I20260619 13:50:44.637485 1497 raft_consensus.cc:697] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f [term 1 LEADER]: Becoming Leader. State: Replica: 380c26fd105f454cbe8ef6b87e35f41f, State: Running, Role: LEADER
I20260619 13:50:44.638070 1497 consensus_queue.cc:237] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.689519 1482 raft_consensus.cc:493] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:50:44.689769 1482 raft_consensus.cc:515] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.691699 1482 leader_election.cc:290] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
I20260619 13:50:44.701084 1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3491c8ba98ae45c1a6ba15a03d9d55f2" candidate_uuid: "94599283b9334819b3bbe25509b7cd16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "380c26fd105f454cbe8ef6b87e35f41f" is_pre_election: true
I20260619 13:50:44.701380 1068 raft_consensus.cc:2468] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94599283b9334819b3bbe25509b7cd16 in term 0.
I20260619 13:50:44.702047 1140 leader_election.cc:304] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f, 94599283b9334819b3bbe25509b7cd16; no voters:
I20260619 13:50:44.702560 1482 raft_consensus.cc:2804] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 13:50:44.702705 1482 raft_consensus.cc:493] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 13:50:44.702823 1482 raft_consensus.cc:3060] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:44.705942 1482 raft_consensus.cc:515] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.707245 1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3491c8ba98ae45c1a6ba15a03d9d55f2" candidate_uuid: "94599283b9334819b3bbe25509b7cd16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "380c26fd105f454cbe8ef6b87e35f41f"
I20260619 13:50:44.707470 1068 raft_consensus.cc:3060] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:44.710248 1068 raft_consensus.cc:2468] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 380c26fd105f454cbe8ef6b87e35f41f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94599283b9334819b3bbe25509b7cd16 in term 1.
I20260619 13:50:44.710933 1140 leader_election.cc:304] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f, 94599283b9334819b3bbe25509b7cd16; no voters:
I20260619 13:50:44.718307 1482 leader_election.cc:290] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16 [CANDIDATE]: Term 1 election: Requested vote from peers 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
I20260619 13:50:44.718634 1482 raft_consensus.cc:2804] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 13:50:44.718861 1482 raft_consensus.cc:697] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16 [term 1 LEADER]: Becoming Leader. State: Replica: 94599283b9334819b3bbe25509b7cd16, State: Running, Role: LEADER
I20260619 13:50:44.719416 1482 consensus_queue.cc:237] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
13:50:44.727 [HMS - ERROR - pool-6-thread-1] (RetryingHMSHandler.java:201) AlreadyExistsException(message:Table hive.default.table_c52ddc84a5e24c718eba7aab2234f558 already exists)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:1839)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:1786)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_with_environment_context(HiveMetaStore.java:2035)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108)
at jdk.proxy2/jdk.proxy2.$Proxy27.create_table_with_environment_context(Unknown Source)
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:14800)
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:14784)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:104)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:840)
W20260619 13:50:44.736253 872 catalog_manager.cc:2195] Already present: failed to create HMS catalog entry for table [id=aabcb66cd3a4456fb2430a4b2ce6d5b9]: failed to create Hive MetaStore table: TException - service has thrown: AlreadyExistsException(message=Table hive.default.table_c52ddc84a5e24c718eba7aab2234f558 already exists)
I20260619 13:50:44.742456 1322 tablet_service.cc:1558] Processing DeleteTablet for tablet f2f0f4c1f6d94839ada7c9951b0ef7bc with delete_type TABLET_DATA_DELETED (replaced by tablet c8d8f0fa96f04d2b9dd9e4a3e7c97041) from {username='slave'} at 127.0.0.1:45026
I20260619 13:50:44.742902 1471 tablet_replica.cc:333] T f2f0f4c1f6d94839ada7c9951b0ef7bc P d54f30d62f034b35a8e73ff525ba43d9: stopping tablet replica
I20260619 13:50:44.743129 1471 raft_consensus.cc:2243] T f2f0f4c1f6d94839ada7c9951b0ef7bc P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 13:50:44.743312 1471 raft_consensus.cc:2272] T f2f0f4c1f6d94839ada7c9951b0ef7bc P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 13:50:44.743918 1471 ts_tablet_manager.cc:1916] T f2f0f4c1f6d94839ada7c9951b0ef7bc P d54f30d62f034b35a8e73ff525ba43d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 13:50:44.746970 1046 tablet_service.cc:1558] Processing DeleteTablet for tablet f2f0f4c1f6d94839ada7c9951b0ef7bc with delete_type TABLET_DATA_DELETED (replaced by tablet c8d8f0fa96f04d2b9dd9e4a3e7c97041) from {username='slave'} at 127.0.0.1:47424
I20260619 13:50:44.747931 1046 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e3a389b382e44299fb9a88d0d28cd1a with delete_type TABLET_DATA_DELETED (replaced by tablet 3491c8ba98ae45c1a6ba15a03d9d55f2) from {username='slave'} at 127.0.0.1:47424
I20260619 13:50:44.748518 1469 tablet_replica.cc:333] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 380c26fd105f454cbe8ef6b87e35f41f: stopping tablet replica
I20260619 13:50:44.748989 1469 raft_consensus.cc:2243] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 13:50:44.749356 1469 raft_consensus.cc:2272] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 13:50:44.752871 1184 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e3a389b382e44299fb9a88d0d28cd1a with delete_type TABLET_DATA_DELETED (replaced by tablet 3491c8ba98ae45c1a6ba15a03d9d55f2) from {username='slave'} at 127.0.0.1:34286
I20260619 13:50:44.753249 1470 tablet_replica.cc:333] T 0e3a389b382e44299fb9a88d0d28cd1a P 94599283b9334819b3bbe25509b7cd16: stopping tablet replica
I20260619 13:50:44.753767 1470 raft_consensus.cc:2243] T 0e3a389b382e44299fb9a88d0d28cd1a P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 13:50:44.754555 1184 tablet_service.cc:1558] Processing DeleteTablet for tablet f2f0f4c1f6d94839ada7c9951b0ef7bc with delete_type TABLET_DATA_DELETED (replaced by tablet c8d8f0fa96f04d2b9dd9e4a3e7c97041) from {username='slave'} at 127.0.0.1:34286
I20260619 13:50:44.756361 872 catalog_manager.cc:5696] T 81c901680eb84fe7ae5957ca045f2d69 P d54f30d62f034b35a8e73ff525ba43d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67). New cstate: current_term: 1 leader_uuid: "d54f30d62f034b35a8e73ff525ba43d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } health_report { overall_health: HEALTHY } } }
I20260619 13:50:44.756871 1470 raft_consensus.cc:2272] T 0e3a389b382e44299fb9a88d0d28cd1a P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 13:50:44.758718 1470 ts_tablet_manager.cc:1916] T 0e3a389b382e44299fb9a88d0d28cd1a P 94599283b9334819b3bbe25509b7cd16: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 13:50:44.762745 1469 ts_tablet_manager.cc:1916] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 380c26fd105f454cbe8ef6b87e35f41f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 13:50:44.770181 1471 ts_tablet_manager.cc:1929] T f2f0f4c1f6d94839ada7c9951b0ef7bc P d54f30d62f034b35a8e73ff525ba43d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 13:50:44.770376 1471 log.cc:1199] T f2f0f4c1f6d94839ada7c9951b0ef7bc P d54f30d62f034b35a8e73ff525ba43d9: Deleting WAL directory at /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-2/wal/wals/f2f0f4c1f6d94839ada7c9951b0ef7bc
I20260619 13:50:44.770764 1471 ts_tablet_manager.cc:1950] T f2f0f4c1f6d94839ada7c9951b0ef7bc P d54f30d62f034b35a8e73ff525ba43d9: Deleting consensus metadata
I20260619 13:50:44.771899 864 catalog_manager.cc:5027] TS d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): tablet f2f0f4c1f6d94839ada7c9951b0ef7bc (table default.table_6a76b7745ccc406facfc1fc1021b24d9 [id=d0fb54a9a55b4a3b83f7c809ef7d24ea]) successfully deleted
I20260619 13:50:44.776625 1469 ts_tablet_manager.cc:1929] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 380c26fd105f454cbe8ef6b87e35f41f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 13:50:44.776753 1470 ts_tablet_manager.cc:1929] T 0e3a389b382e44299fb9a88d0d28cd1a P 94599283b9334819b3bbe25509b7cd16: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 13:50:44.776913 1470 log.cc:1199] T 0e3a389b382e44299fb9a88d0d28cd1a P 94599283b9334819b3bbe25509b7cd16: Deleting WAL directory at /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-1/wal/wals/0e3a389b382e44299fb9a88d0d28cd1a
I20260619 13:50:44.777390 1470 ts_tablet_manager.cc:1950] T 0e3a389b382e44299fb9a88d0d28cd1a P 94599283b9334819b3bbe25509b7cd16: Deleting consensus metadata
I20260619 13:50:44.778091 1342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3491c8ba98ae45c1a6ba15a03d9d55f2" candidate_uuid: "94599283b9334819b3bbe25509b7cd16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f30d62f034b35a8e73ff525ba43d9" is_pre_election: true
I20260619 13:50:44.778349 1342 raft_consensus.cc:2468] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94599283b9334819b3bbe25509b7cd16 in term 0.
I20260619 13:50:44.779065 1342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3491c8ba98ae45c1a6ba15a03d9d55f2" candidate_uuid: "94599283b9334819b3bbe25509b7cd16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f30d62f034b35a8e73ff525ba43d9"
I20260619 13:50:44.779264 1342 raft_consensus.cc:3060] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:44.779829 1469 log.cc:1199] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 380c26fd105f454cbe8ef6b87e35f41f: Deleting WAL directory at /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-0/wal/wals/f2f0f4c1f6d94839ada7c9951b0ef7bc
I20260619 13:50:44.780367 1469 ts_tablet_manager.cc:1950] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 380c26fd105f454cbe8ef6b87e35f41f: Deleting consensus metadata
I20260619 13:50:44.782080 1342 raft_consensus.cc:2468] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P d54f30d62f034b35a8e73ff525ba43d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94599283b9334819b3bbe25509b7cd16 in term 1.
I20260619 13:50:44.788211 863 catalog_manager.cc:5027] TS 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): tablet f2f0f4c1f6d94839ada7c9951b0ef7bc (table default.table_6a76b7745ccc406facfc1fc1021b24d9 [id=d0fb54a9a55b4a3b83f7c809ef7d24ea]) successfully deleted
I20260619 13:50:44.788726 872 catalog_manager.cc:5696] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 94599283b9334819b3bbe25509b7cd16 (127.0.105.66). New cstate: current_term: 1 leader_uuid: "94599283b9334819b3bbe25509b7cd16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } health_report { overall_health: UNKNOWN } } }
I20260619 13:50:44.789307 1469 tablet_replica.cc:333] T 0e3a389b382e44299fb9a88d0d28cd1a P 380c26fd105f454cbe8ef6b87e35f41f: stopping tablet replica
I20260619 13:50:44.789575 1469 raft_consensus.cc:2243] T 0e3a389b382e44299fb9a88d0d28cd1a P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 13:50:44.790828 862 catalog_manager.cc:5027] TS 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): tablet 0e3a389b382e44299fb9a88d0d28cd1a (table default.table_2138876d1fe74e81bfc560e2fb592a0e [id=57c8bf0937b84407ace807934df053c4]) successfully deleted
I20260619 13:50:44.790917 1470 tablet_replica.cc:333] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 94599283b9334819b3bbe25509b7cd16: stopping tablet replica
I20260619 13:50:44.791118 1470 raft_consensus.cc:2243] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260619 13:50:44.791167 1469 raft_consensus.cc:2272] T 0e3a389b382e44299fb9a88d0d28cd1a P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 13:50:44.791289 1470 raft_consensus.cc:2272] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260619 13:50:44.791864 1470 ts_tablet_manager.cc:1916] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 94599283b9334819b3bbe25509b7cd16: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 13:50:44.791904 1469 ts_tablet_manager.cc:1916] T 0e3a389b382e44299fb9a88d0d28cd1a P 380c26fd105f454cbe8ef6b87e35f41f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 13:50:44.804773 1184 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e3a389b382e44299fb9a88d0d28cd1a with delete_type TABLET_DATA_DELETED (replaced by tablet 3491c8ba98ae45c1a6ba15a03d9d55f2) from {username='slave'} at 127.0.0.1:34286
I20260619 13:50:44.809885 1470 ts_tablet_manager.cc:1929] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 94599283b9334819b3bbe25509b7cd16: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 13:50:44.810062 1470 log.cc:1199] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 94599283b9334819b3bbe25509b7cd16: Deleting WAL directory at /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-1/wal/wals/f2f0f4c1f6d94839ada7c9951b0ef7bc
I20260619 13:50:44.810448 1470 ts_tablet_manager.cc:1950] T f2f0f4c1f6d94839ada7c9951b0ef7bc P 94599283b9334819b3bbe25509b7cd16: Deleting consensus metadata
I20260619 13:50:44.811530 862 catalog_manager.cc:5027] TS 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): tablet f2f0f4c1f6d94839ada7c9951b0ef7bc (table default.table_6a76b7745ccc406facfc1fc1021b24d9 [id=d0fb54a9a55b4a3b83f7c809ef7d24ea]) successfully deleted
W20260619 13:50:44.811944 862 catalog_manager.cc:4994] TS 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): delete failed for tablet 0e3a389b382e44299fb9a88d0d28cd1a because the tablet was not found. No further retry: Not found: Tablet not found: 0e3a389b382e44299fb9a88d0d28cd1a
I20260619 13:50:44.812969 872 catalog_manager.cc:5696] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f reported cstate change: term changed from 0 to 1, leader changed from <none> to 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65). New cstate: current_term: 1 leader_uuid: "380c26fd105f454cbe8ef6b87e35f41f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } health_report { overall_health: UNKNOWN } } }
I20260619 13:50:44.816802 1469 ts_tablet_manager.cc:1929] T 0e3a389b382e44299fb9a88d0d28cd1a P 380c26fd105f454cbe8ef6b87e35f41f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 13:50:44.817431 872 catalog_manager.cc:5696] T d66b1eaa29454bb3bc8e2c493d01cb43 P 380c26fd105f454cbe8ef6b87e35f41f reported cstate change: term changed from 0 to 1, leader changed from <none> to 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65). New cstate: current_term: 1 leader_uuid: "380c26fd105f454cbe8ef6b87e35f41f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } health_report { overall_health: UNKNOWN } } }
I20260619 13:50:44.826406 1469 log.cc:1199] T 0e3a389b382e44299fb9a88d0d28cd1a P 380c26fd105f454cbe8ef6b87e35f41f: Deleting WAL directory at /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-0/wal/wals/0e3a389b382e44299fb9a88d0d28cd1a
I20260619 13:50:44.826918 1469 ts_tablet_manager.cc:1950] T 0e3a389b382e44299fb9a88d0d28cd1a P 380c26fd105f454cbe8ef6b87e35f41f: Deleting consensus metadata
I20260619 13:50:44.828177 1046 tablet_service.cc:1558] Processing DeleteTablet for tablet f2f0f4c1f6d94839ada7c9951b0ef7bc with delete_type TABLET_DATA_DELETED (replaced by tablet c8d8f0fa96f04d2b9dd9e4a3e7c97041) from {username='slave'} at 127.0.0.1:47424
I20260619 13:50:44.828507 863 catalog_manager.cc:5027] TS 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): tablet 0e3a389b382e44299fb9a88d0d28cd1a (table default.table_2138876d1fe74e81bfc560e2fb592a0e [id=57c8bf0937b84407ace807934df053c4]) successfully deleted
W20260619 13:50:44.829205 863 catalog_manager.cc:4994] TS 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): delete failed for tablet f2f0f4c1f6d94839ada7c9951b0ef7bc because the tablet was not found. No further retry: Not found: Tablet not found: f2f0f4c1f6d94839ada7c9951b0ef7bc
I20260619 13:50:44.830024 1046 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e3a389b382e44299fb9a88d0d28cd1a with delete_type TABLET_DATA_DELETED (replaced by tablet 3491c8ba98ae45c1a6ba15a03d9d55f2) from {username='slave'} at 127.0.0.1:47424
I20260619 13:50:44.830531 1473 raft_consensus.cc:493] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260619 13:50:44.830600 863 catalog_manager.cc:4994] TS 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): delete failed for tablet 0e3a389b382e44299fb9a88d0d28cd1a because the tablet was not found. No further retry: Not found: Tablet not found: 0e3a389b382e44299fb9a88d0d28cd1a
I20260619 13:50:44.830704 1473 raft_consensus.cc:515] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.831435 1473 leader_election.cc:290] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865), 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481)
I20260619 13:50:44.832176 1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd56579c7a44155a0090e2720566a58" candidate_uuid: "d54f30d62f034b35a8e73ff525ba43d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "380c26fd105f454cbe8ef6b87e35f41f" is_pre_election: true
I20260619 13:50:44.832176 1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd56579c7a44155a0090e2720566a58" candidate_uuid: "d54f30d62f034b35a8e73ff525ba43d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94599283b9334819b3bbe25509b7cd16" is_pre_election: true
I20260619 13:50:44.832410 1205 raft_consensus.cc:2468] T 0fd56579c7a44155a0090e2720566a58 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f30d62f034b35a8e73ff525ba43d9 in term 0.
I20260619 13:50:44.832410 1068 raft_consensus.cc:2468] T 0fd56579c7a44155a0090e2720566a58 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f30d62f034b35a8e73ff525ba43d9 in term 0.
I20260619 13:50:44.832877 1277 leader_election.cc:304] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9; no voters:
I20260619 13:50:44.833289 1473 raft_consensus.cc:2804] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 13:50:44.833431 1473 raft_consensus.cc:493] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 13:50:44.833565 1473 raft_consensus.cc:3060] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:44.833340 872 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49906:
name: "default.Table_b08623aacbde40ed8d75707540765476"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:44.836237 1473 raft_consensus.cc:515] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.837459 1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd56579c7a44155a0090e2720566a58" candidate_uuid: "d54f30d62f034b35a8e73ff525ba43d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "380c26fd105f454cbe8ef6b87e35f41f"
I20260619 13:50:44.837706 1068 raft_consensus.cc:3060] T 0fd56579c7a44155a0090e2720566a58 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:44.840432 1068 raft_consensus.cc:2468] T 0fd56579c7a44155a0090e2720566a58 P 380c26fd105f454cbe8ef6b87e35f41f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f30d62f034b35a8e73ff525ba43d9 in term 1.
I20260619 13:50:44.841037 1278 leader_election.cc:304] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f, d54f30d62f034b35a8e73ff525ba43d9; no voters:
I20260619 13:50:44.842195 1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd56579c7a44155a0090e2720566a58" candidate_uuid: "d54f30d62f034b35a8e73ff525ba43d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94599283b9334819b3bbe25509b7cd16"
I20260619 13:50:44.842447 1205 raft_consensus.cc:3060] T 0fd56579c7a44155a0090e2720566a58 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:44.842850 877 catalog_manager.cc:2199] created HMS catalog entry for table [id=2f052b286bee49df9c7ae8cd8ecfd90b]
I20260619 13:50:44.843709 1467 raft_consensus.cc:2804] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 13:50:44.849843 877 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49906 (request call id 14) took 1058 ms. Trace:
I20260619 13:50:44.850375 1467 raft_consensus.cc:697] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 [term 1 LEADER]: Becoming Leader. State: Replica: d54f30d62f034b35a8e73ff525ba43d9, State: Running, Role: LEADER
I20260619 13:50:44.849995 877 rpcz_store.cc:276] 0619 13:50:43.791485 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 13:50:43.793181 (+ 1696us) service_pool.cc:224] Handling call
0619 13:50:43.796862 (+ 3681us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x617000007ce0. stack: 00007fcf0ec99496 00007fcf0ec99250 00007fcf0dcc43ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fcf0ec8ef2d 00007fcf0ec8fd6e 00007fcf22b836cd 00007fcf22ae9c48 00007fcf22aa74c8 00007fcf22c3a6c3 00007fcf196967c6 00007fcf196964f5 00007fcf15da388e 00007fcf15da276e
0619 13:50:43.799295 (+ 2433us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x616000041b54. stack: 00007fcf0ec99496 00007fcf0ec99250 00007fcf0dcc43ad 000000000099c914 000000000099c8dd 00007fcf1e17a6bd 00007fcf1e17a7b3 00007fcf1ad42b21 00007fcf22aa795d 00007fcf22c3a6c3 00007fcf196967c6 00007fcf196964f5 00007fcf15da388e 00007fcf15da276e 00007fcf15da89a8 00007fcf15da930f
0619 13:50:43.819156 (+ 19861us) catalog_manager.cc:2126] Acquired catalog manager lock
0619 13:50:43.819621 (+ 465us) catalog_manager.cc:2172] Created new table and tablet info
0619 13:50:44.842821 (+1023200us) catalog_manager.cc:2198] Created new table in HMS catalog
0619 13:50:44.849550 (+ 6729us) catalog_manager.cc:2232] Wrote table and tablets to system table
0619 13:50:44.849664 (+ 114us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0619 13:50:44.849777 (+ 113us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 13:50:44.844081 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 13:50:44.844214 (+ 133us) write_op.cc:432] Acquiring schema lock in shared mode
0619 13:50:44.844221 (+ 7us) write_op.cc:435] Acquired schema lock
0619 13:50:44.844223 (+ 2us) tablet.cc:662] Decoding operations
0619 13:50:44.844317 (+ 94us) write_op.cc:620] Acquiring the partition lock for write op
0619 13:50:44.844332 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0619 13:50:44.844337 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0619 13:50:44.844418 (+ 81us) tablet.cc:701] Row locks acquired
0619 13:50:44.844420 (+ 2us) write_op.cc:260] PREPARE: finished
0619 13:50:44.844460 (+ 40us) write_op.cc:270] Start()
0619 13:50:44.844495 (+ 35us) write_op.cc:276] Timestamp: P: 1781877044844323 usec, L: 0
0619 13:50:44.844498 (+ 3us) op_driver.cc:348] REPLICATION: starting
0619 13:50:44.844698 (+ 200us) log.cc:844] Serialized 432 byte log entry
0619 13:50:44.848135 (+ 3437us) op_driver.cc:464] REPLICATION: finished
0619 13:50:44.848262 (+ 127us) write_op.cc:301] APPLY: starting
0619 13:50:44.848279 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0619 13:50:44.848337 (+ 58us) tablet.cc:1370] finished BulkCheckPresence
0619 13:50:44.848378 (+ 41us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 13:50:44.848480 (+ 102us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 13:50:44.848517 (+ 37us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0619 13:50:44.848525 (+ 8us) write_op.cc:312] APPLY: finished
0619 13:50:44.848605 (+ 80us) log.cc:844] Serialized 28 byte log entry
0619 13:50:44.848668 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0619 13:50:44.848689 (+ 21us) write_op.cc:454] Released schema lock
0619 13:50:44.848696 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0619 13:50:44.848762 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0619 13:50:44.848767 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":915981,"Hive Metastore.run_cpu_time_us":421,"Hive Metastore.run_wall_time_us":105277,"spinlock_wait_cycles":8669312,"child_traces":[["op",{"apply.queue_time_us":80,"apply.run_cpu_time_us":489,"apply.run_wall_time_us":489,"num_ops":2,"prepare.queue_time_us":503,"prepare.run_cpu_time_us":774,"prepare.run_wall_time_us":775,"raft.queue_time_us":157,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":294,"replication_time_us":3606}]]}
I20260619 13:50:44.850737 1467 consensus_queue.cc:237] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:44.851712 877 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49906:
name: "default.Table_8c43993fce7349e49137eb5cb7ed4fc7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:44.862869 1184 tablet_service.cc:1511] Processing CreateTablet for tablet afd1f4707bec4f61b6001eb88426f985 (DEFAULT_TABLE table=default.table_06260aeaf35a4709a2f2596a0268c737 [id=2f052b286bee49df9c7ae8cd8ecfd90b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:44.863365 1184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afd1f4707bec4f61b6001eb88426f985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:44.866489 1046 tablet_service.cc:1511] Processing CreateTablet for tablet afd1f4707bec4f61b6001eb88426f985 (DEFAULT_TABLE table=default.table_06260aeaf35a4709a2f2596a0268c737 [id=2f052b286bee49df9c7ae8cd8ecfd90b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:44.866703 1322 tablet_service.cc:1511] Processing CreateTablet for tablet afd1f4707bec4f61b6001eb88426f985 (DEFAULT_TABLE table=default.table_06260aeaf35a4709a2f2596a0268c737 [id=2f052b286bee49df9c7ae8cd8ecfd90b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:44.866990 1046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afd1f4707bec4f61b6001eb88426f985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:44.867089 1322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afd1f4707bec4f61b6001eb88426f985. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:44.874377 1462 tablet_bootstrap.cc:492] T afd1f4707bec4f61b6001eb88426f985 P 380c26fd105f454cbe8ef6b87e35f41f: Bootstrap starting.
I20260619 13:50:44.874979 1205 raft_consensus.cc:2468] T 0fd56579c7a44155a0090e2720566a58 P 94599283b9334819b3bbe25509b7cd16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f30d62f034b35a8e73ff525ba43d9 in term 1.
I20260619 13:50:44.876435 1462 tablet_bootstrap.cc:654] T afd1f4707bec4f61b6001eb88426f985 P 380c26fd105f454cbe8ef6b87e35f41f: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:44.879747 1473 leader_election.cc:290] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 [CANDIDATE]: Term 1 election: Requested vote from peers 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865), 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481)
I20260619 13:50:44.882140 1463 tablet_bootstrap.cc:492] T afd1f4707bec4f61b6001eb88426f985 P d54f30d62f034b35a8e73ff525ba43d9: Bootstrap starting.
I20260619 13:50:44.882777 1461 tablet_bootstrap.cc:492] T afd1f4707bec4f61b6001eb88426f985 P 94599283b9334819b3bbe25509b7cd16: Bootstrap starting.
I20260619 13:50:44.884083 1463 tablet_bootstrap.cc:654] T afd1f4707bec4f61b6001eb88426f985 P d54f30d62f034b35a8e73ff525ba43d9: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:44.884495 1461 tablet_bootstrap.cc:654] T afd1f4707bec4f61b6001eb88426f985 P 94599283b9334819b3bbe25509b7cd16: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:44.886790 1462 tablet_bootstrap.cc:492] T afd1f4707bec4f61b6001eb88426f985 P 380c26fd105f454cbe8ef6b87e35f41f: No bootstrap required, opened a new log
I20260619 13:50:44.886992 1462 ts_tablet_manager.cc:1403] T afd1f4707bec4f61b6001eb88426f985 P 380c26fd105f454cbe8ef6b87e35f41f: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.001s
I20260619 13:50:44.888089 1462 raft_consensus.cc:359] T afd1f4707bec4f61b6001eb88426f985 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } }
I20260619 13:50:44.888300 1462 raft_consensus.cc:385] T afd1f4707bec4f61b6001eb88426f985 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:44.888396 1462 raft_consensus.cc:740] T afd1f4707bec4f61b6001eb88426f985 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 380c26fd105f454cbe8ef6b87e35f41f, State: Initialized, Role: FOLLOWER
I20260619 13:50:44.888649 1462 consensus_queue.cc:260] T afd1f4707bec4f61b6001eb88426f985 P 380c26fd105f454cbe8ef6b87e35f41f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } }
I20260619 13:50:44.889194 1462 ts_tablet_manager.cc:1434] T afd1f4707bec4f61b6001eb88426f985 P 380c26fd105f454cbe8ef6b87e35f41f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 13:50:44.906105 1463 tablet_bootstrap.cc:492] T afd1f4707bec4f61b6001eb88426f985 P d54f30d62f034b35a8e73ff525ba43d9: No bootstrap required, opened a new log
I20260619 13:50:44.906304 1463 ts_tablet_manager.cc:1403] T afd1f4707bec4f61b6001eb88426f985 P d54f30d62f034b35a8e73ff525ba43d9: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.008s
I20260619 13:50:44.907162 1463 raft_consensus.cc:359] T afd1f4707bec4f61b6001eb88426f985 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } }
I20260619 13:50:44.907362 1463 raft_consensus.cc:385] T afd1f4707bec4f61b6001eb88426f985 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:44.907447 1463 raft_consensus.cc:740] T afd1f4707bec4f61b6001eb88426f985 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f30d62f034b35a8e73ff525ba43d9, State: Initialized, Role: FOLLOWER
I20260619 13:50:44.907773 1463 consensus_queue.cc:260] T afd1f4707bec4f61b6001eb88426f985 P d54f30d62f034b35a8e73ff525ba43d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } }
I20260619 13:50:44.910732 1463 ts_tablet_manager.cc:1434] T afd1f4707bec4f61b6001eb88426f985 P d54f30d62f034b35a8e73ff525ba43d9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260619 13:50:44.936292 1461 tablet_bootstrap.cc:492] T afd1f4707bec4f61b6001eb88426f985 P 94599283b9334819b3bbe25509b7cd16: No bootstrap required, opened a new log
I20260619 13:50:44.936512 1461 ts_tablet_manager.cc:1403] T afd1f4707bec4f61b6001eb88426f985 P 94599283b9334819b3bbe25509b7cd16: Time spent bootstrapping tablet: real 0.054s user 0.006s sys 0.025s
I20260619 13:50:44.937397 1461 raft_consensus.cc:359] T afd1f4707bec4f61b6001eb88426f985 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } }
I20260619 13:50:44.937623 1461 raft_consensus.cc:385] T afd1f4707bec4f61b6001eb88426f985 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:44.937711 1461 raft_consensus.cc:740] T afd1f4707bec4f61b6001eb88426f985 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94599283b9334819b3bbe25509b7cd16, State: Initialized, Role: FOLLOWER
I20260619 13:50:44.938026 1461 consensus_queue.cc:260] T afd1f4707bec4f61b6001eb88426f985 P 94599283b9334819b3bbe25509b7cd16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } }
I20260619 13:50:44.938575 1461 ts_tablet_manager.cc:1434] T afd1f4707bec4f61b6001eb88426f985 P 94599283b9334819b3bbe25509b7cd16: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 13:50:44.959820 874 catalog_manager.cc:2199] created HMS catalog entry for table [id=e009fdd5a6e2488f9f7bfa3ed6005316]
I20260619 13:50:44.966430 874 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49906 (request call id 17) took 1174 ms. Trace:
I20260619 13:50:44.966590 874 rpcz_store.cc:276] 0619 13:50:43.791929 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 13:50:43.792007 (+ 78us) service_pool.cc:224] Handling call
0619 13:50:43.796152 (+ 4145us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x617000007ce0. stack: 00007fcf0ec99496 00007fcf0ec99250 00007fcf0dcc43ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fcf0ec8ef2d 00007fcf0ec8fd6e 00007fcf22b836cd 00007fcf22ae9c48 00007fcf22aa74c8 00007fcf22c3a6c3 00007fcf196967c6 00007fcf196964f5 00007fcf15da388e 00007fcf15da276e
0619 13:50:43.800235 (+ 4083us) spinlock_profiling.cc:243] Waited 3.9 ms on lock 0x616000041b54. stack: 00007fcf0ec99496 00007fcf0ec99250 00007fcf0dcc43ad 000000000099c914 000000000099c8dd 00007fcf1e17a6bd 00007fcf1e17a7b3 00007fcf1ad42b21 00007fcf22aa795d 00007fcf22c3a6c3 00007fcf196967c6 00007fcf196964f5 00007fcf15da388e 00007fcf15da276e 00007fcf15da89a8 00007fcf15da930f
0619 13:50:43.820256 (+ 20021us) catalog_manager.cc:2126] Acquired catalog manager lock
0619 13:50:43.820705 (+ 449us) catalog_manager.cc:2172] Created new table and tablet info
0619 13:50:44.959755 (+1139050us) catalog_manager.cc:2198] Created new table in HMS catalog
0619 13:50:44.966124 (+ 6369us) catalog_manager.cc:2232] Wrote table and tablets to system table
0619 13:50:44.966262 (+ 138us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0619 13:50:44.966380 (+ 118us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 13:50:44.960707 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 13:50:44.960845 (+ 138us) write_op.cc:432] Acquiring schema lock in shared mode
0619 13:50:44.960852 (+ 7us) write_op.cc:435] Acquired schema lock
0619 13:50:44.960854 (+ 2us) tablet.cc:662] Decoding operations
0619 13:50:44.960952 (+ 98us) write_op.cc:620] Acquiring the partition lock for write op
0619 13:50:44.960968 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0619 13:50:44.960973 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0619 13:50:44.961059 (+ 86us) tablet.cc:701] Row locks acquired
0619 13:50:44.961061 (+ 2us) write_op.cc:260] PREPARE: finished
0619 13:50:44.961105 (+ 44us) write_op.cc:270] Start()
0619 13:50:44.961139 (+ 34us) write_op.cc:276] Timestamp: P: 1781877044960906 usec, L: 0
0619 13:50:44.961143 (+ 4us) op_driver.cc:348] REPLICATION: starting
0619 13:50:44.961351 (+ 208us) log.cc:844] Serialized 432 byte log entry
0619 13:50:44.965360 (+ 4009us) op_driver.cc:464] REPLICATION: finished
0619 13:50:44.965529 (+ 169us) write_op.cc:301] APPLY: starting
0619 13:50:44.965547 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0619 13:50:44.965594 (+ 47us) tablet.cc:1370] finished BulkCheckPresence
0619 13:50:44.965621 (+ 27us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 13:50:44.965725 (+ 104us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 13:50:44.965763 (+ 38us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0619 13:50:44.965771 (+ 8us) write_op.cc:312] APPLY: finished
0619 13:50:44.965850 (+ 79us) log.cc:844] Serialized 28 byte log entry
0619 13:50:44.965915 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0619 13:50:44.965937 (+ 22us) write_op.cc:454] Released schema lock
0619 13:50:44.965944 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0619 13:50:44.966023 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0619 13:50:44.966026 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1020238,"Hive Metastore.run_cpu_time_us":312,"Hive Metastore.run_wall_time_us":118386,"spinlock_wait_cycles":12445440,"child_traces":[["op",{"apply.queue_time_us":80,"apply.run_cpu_time_us":514,"apply.run_wall_time_us":513,"num_ops":2,"prepare.queue_time_us":77,"prepare.run_cpu_time_us":800,"prepare.run_wall_time_us":801,"raft.queue_time_us":1052,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":312,"replication_time_us":4187}]]}
I20260619 13:50:44.977478 874 catalog_manager.cc:5696] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67). New cstate: current_term: 1 leader_uuid: "d54f30d62f034b35a8e73ff525ba43d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } health_report { overall_health: HEALTHY } } }
I20260619 13:50:44.980876 1322 tablet_service.cc:1511] Processing CreateTablet for tablet c72a70b85f464558a625e293380f610b (DEFAULT_TABLE table=default.table_8ba4a12b36bd4159a70fe23f31c1e862 [id=e009fdd5a6e2488f9f7bfa3ed6005316]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:44.981400 1322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72a70b85f464558a625e293380f610b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:44.981418 1184 tablet_service.cc:1511] Processing CreateTablet for tablet c72a70b85f464558a625e293380f610b (DEFAULT_TABLE table=default.table_8ba4a12b36bd4159a70fe23f31c1e862 [id=e009fdd5a6e2488f9f7bfa3ed6005316]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:44.981889 1184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72a70b85f464558a625e293380f610b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:44.987915 1463 tablet_bootstrap.cc:492] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9: Bootstrap starting.
I20260619 13:50:44.988124 1461 tablet_bootstrap.cc:492] T c72a70b85f464558a625e293380f610b P 94599283b9334819b3bbe25509b7cd16: Bootstrap starting.
I20260619 13:50:44.988349 1046 tablet_service.cc:1511] Processing CreateTablet for tablet c72a70b85f464558a625e293380f610b (DEFAULT_TABLE table=default.table_8ba4a12b36bd4159a70fe23f31c1e862 [id=e009fdd5a6e2488f9f7bfa3ed6005316]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:44.988765 1046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72a70b85f464558a625e293380f610b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:44.989892 1461 tablet_bootstrap.cc:654] T c72a70b85f464558a625e293380f610b P 94599283b9334819b3bbe25509b7cd16: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:44.990062 1463 tablet_bootstrap.cc:654] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:44.996858 1462 tablet_bootstrap.cc:492] T c72a70b85f464558a625e293380f610b P 380c26fd105f454cbe8ef6b87e35f41f: Bootstrap starting.
I20260619 13:50:44.999315 1462 tablet_bootstrap.cc:654] T c72a70b85f464558a625e293380f610b P 380c26fd105f454cbe8ef6b87e35f41f: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:45.009904 874 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49906:
table { table_name: "default.Table_c1ef2fe395ec45c98ee34472a137d486" } new_table_name: "default.Table_de9cc9659e5542e482897905c4fd7381" modify_external_catalogs: true
I20260619 13:50:45.011153 1463 tablet_bootstrap.cc:492] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9: No bootstrap required, opened a new log
I20260619 13:50:45.011461 1463 ts_tablet_manager.cc:1403] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9: Time spent bootstrapping tablet: real 0.024s user 0.008s sys 0.002s
I20260619 13:50:45.012496 1463 raft_consensus.cc:359] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } }
I20260619 13:50:45.012821 1463 raft_consensus.cc:385] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:45.012943 1463 raft_consensus.cc:740] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f30d62f034b35a8e73ff525ba43d9, State: Initialized, Role: FOLLOWER
I20260619 13:50:45.013358 1463 consensus_queue.cc:260] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } }
I20260619 13:50:45.014593 1461 tablet_bootstrap.cc:492] T c72a70b85f464558a625e293380f610b P 94599283b9334819b3bbe25509b7cd16: No bootstrap required, opened a new log
I20260619 13:50:45.014816 1461 ts_tablet_manager.cc:1403] T c72a70b85f464558a625e293380f610b P 94599283b9334819b3bbe25509b7cd16: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.003s
I20260619 13:50:45.016135 1461 raft_consensus.cc:359] T c72a70b85f464558a625e293380f610b P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } }
I20260619 13:50:45.016417 1461 raft_consensus.cc:385] T c72a70b85f464558a625e293380f610b P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:45.016512 1461 raft_consensus.cc:740] T c72a70b85f464558a625e293380f610b P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94599283b9334819b3bbe25509b7cd16, State: Initialized, Role: FOLLOWER
I20260619 13:50:45.016894 1461 consensus_queue.cc:260] T c72a70b85f464558a625e293380f610b P 94599283b9334819b3bbe25509b7cd16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } }
I20260619 13:50:45.017616 1461 ts_tablet_manager.cc:1434] T c72a70b85f464558a625e293380f610b P 94599283b9334819b3bbe25509b7cd16: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260619 13:50:45.018533 1463 ts_tablet_manager.cc:1434] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260619 13:50:45.019035 1462 tablet_bootstrap.cc:492] T c72a70b85f464558a625e293380f610b P 380c26fd105f454cbe8ef6b87e35f41f: No bootstrap required, opened a new log
I20260619 13:50:45.023099 1462 ts_tablet_manager.cc:1403] T c72a70b85f464558a625e293380f610b P 380c26fd105f454cbe8ef6b87e35f41f: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.008s
I20260619 13:50:45.024255 1462 raft_consensus.cc:359] T c72a70b85f464558a625e293380f610b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } }
I20260619 13:50:45.024636 1462 raft_consensus.cc:385] T c72a70b85f464558a625e293380f610b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:45.024807 1462 raft_consensus.cc:740] T c72a70b85f464558a625e293380f610b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 380c26fd105f454cbe8ef6b87e35f41f, State: Initialized, Role: FOLLOWER
I20260619 13:50:45.025228 1462 consensus_queue.cc:260] T c72a70b85f464558a625e293380f610b P 380c26fd105f454cbe8ef6b87e35f41f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } }
I20260619 13:50:45.032357 1462 ts_tablet_manager.cc:1434] T c72a70b85f464558a625e293380f610b P 380c26fd105f454cbe8ef6b87e35f41f: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260619 13:50:45.063338 1482 raft_consensus.cc:493] T 81c901680eb84fe7ae5957ca045f2d69 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:50:45.063571 1482 raft_consensus.cc:515] T 81c901680eb84fe7ae5957ca045f2d69 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:45.064284 1482 leader_election.cc:290] T 81c901680eb84fe7ae5957ca045f2d69 P 94599283b9334819b3bbe25509b7cd16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
I20260619 13:50:45.064911 1342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c901680eb84fe7ae5957ca045f2d69" candidate_uuid: "94599283b9334819b3bbe25509b7cd16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f30d62f034b35a8e73ff525ba43d9" is_pre_election: true
I20260619 13:50:45.064904 1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81c901680eb84fe7ae5957ca045f2d69" candidate_uuid: "94599283b9334819b3bbe25509b7cd16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "380c26fd105f454cbe8ef6b87e35f41f" is_pre_election: true
I20260619 13:50:45.065222 1068 raft_consensus.cc:2393] T 81c901680eb84fe7ae5957ca045f2d69 P 380c26fd105f454cbe8ef6b87e35f41f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94599283b9334819b3bbe25509b7cd16 in current term 1: Already voted for candidate d54f30d62f034b35a8e73ff525ba43d9 in this term.
I20260619 13:50:45.065742 1140 leader_election.cc:304] T 81c901680eb84fe7ae5957ca045f2d69 P 94599283b9334819b3bbe25509b7cd16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94599283b9334819b3bbe25509b7cd16; no voters: 380c26fd105f454cbe8ef6b87e35f41f, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:50:45.066102 1482 raft_consensus.cc:3060] T 81c901680eb84fe7ae5957ca045f2d69 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:45.067121 1497 raft_consensus.cc:493] T afd1f4707bec4f61b6001eb88426f985 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:50:45.067301 1497 raft_consensus.cc:515] T afd1f4707bec4f61b6001eb88426f985 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } }
I20260619 13:50:45.068006 1497 leader_election.cc:290] T afd1f4707bec4f61b6001eb88426f985 P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847), 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481)
I20260619 13:50:45.068807 1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd1f4707bec4f61b6001eb88426f985" candidate_uuid: "380c26fd105f454cbe8ef6b87e35f41f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94599283b9334819b3bbe25509b7cd16" is_pre_election: true
I20260619 13:50:45.069238 1205 raft_consensus.cc:2468] T afd1f4707bec4f61b6001eb88426f985 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 380c26fd105f454cbe8ef6b87e35f41f in term 0.
I20260619 13:50:45.069804 1002 leader_election.cc:304] T afd1f4707bec4f61b6001eb88426f985 P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f, 94599283b9334819b3bbe25509b7cd16; no voters:
I20260619 13:50:45.070107 1497 raft_consensus.cc:2804] T afd1f4707bec4f61b6001eb88426f985 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 13:50:45.070231 1497 raft_consensus.cc:493] T afd1f4707bec4f61b6001eb88426f985 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 13:50:45.070312 1497 raft_consensus.cc:3060] T afd1f4707bec4f61b6001eb88426f985 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:45.070559 1342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd1f4707bec4f61b6001eb88426f985" candidate_uuid: "380c26fd105f454cbe8ef6b87e35f41f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f30d62f034b35a8e73ff525ba43d9" is_pre_election: true
I20260619 13:50:45.071044 1342 raft_consensus.cc:2468] T afd1f4707bec4f61b6001eb88426f985 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 380c26fd105f454cbe8ef6b87e35f41f in term 0.
W20260619 13:50:45.130234 1474 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 13:50:45.130661 1474 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 13:50:45.130767 1474 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260619 13:50:45.143750 1474 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 13:50:45.143885 1474 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260619 13:50:45.143980 1474 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 13:50:45.144057 1474 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260619 13:50:45.144026 1482 raft_consensus.cc:2749] T 81c901680eb84fe7ae5957ca045f2d69 P 94599283b9334819b3bbe25509b7cd16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 13:50:45.144045 1497 raft_consensus.cc:515] T afd1f4707bec4f61b6001eb88426f985 P 380c26fd105f454cbe8ef6b87e35f41f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } }
I20260619 13:50:45.144907 1497 leader_election.cc:290] T afd1f4707bec4f61b6001eb88426f985 P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 election: Requested vote from peers d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847), 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481)
I20260619 13:50:45.148962 870 catalog_manager.cc:2199] created HMS catalog entry for table [id=7774d59813b44a19864817d47194e724]
I20260619 13:50:45.148955 1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd1f4707bec4f61b6001eb88426f985" candidate_uuid: "380c26fd105f454cbe8ef6b87e35f41f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94599283b9334819b3bbe25509b7cd16"
I20260619 13:50:45.149212 1205 raft_consensus.cc:3060] T afd1f4707bec4f61b6001eb88426f985 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:45.152168 1342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd1f4707bec4f61b6001eb88426f985" candidate_uuid: "380c26fd105f454cbe8ef6b87e35f41f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f30d62f034b35a8e73ff525ba43d9"
I20260619 13:50:45.152408 1342 raft_consensus.cc:3060] T afd1f4707bec4f61b6001eb88426f985 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:45.158109 870 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49906 (request call id 21) took 1365 ms. Trace:
I20260619 13:50:45.158262 870 rpcz_store.cc:276] 0619 13:50:43.792344 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 13:50:43.793729 (+ 1385us) service_pool.cc:224] Handling call
0619 13:50:43.796407 (+ 2678us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x617000007ce0. stack: 00007fcf0ec99496 00007fcf0ec99250 00007fcf0dcc43ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fcf0ec8ef2d 00007fcf0ec8fd6e 00007fcf22b836cd 00007fcf22ae9c48 00007fcf22aa74c8 00007fcf22c3a6c3 00007fcf196967c6 00007fcf196964f5 00007fcf15da388e 00007fcf15da276e
0619 13:50:43.799439 (+ 3032us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x616000041b54. stack: 00007fcf0ec99496 00007fcf0ec99250 00007fcf0dcc43ad 000000000099c914 000000000099c8dd 00007fcf1e17a6bd 00007fcf1e17a7b3 00007fcf1ad42b21 00007fcf22aa795d 00007fcf22c3a6c3 00007fcf196967c6 00007fcf196964f5 00007fcf15da388e 00007fcf15da276e 00007fcf15da89a8 00007fcf15da930f
0619 13:50:43.821313 (+ 21874us) catalog_manager.cc:2126] Acquired catalog manager lock
0619 13:50:43.821774 (+ 461us) catalog_manager.cc:2172] Created new table and tablet info
0619 13:50:45.148897 (+1327123us) catalog_manager.cc:2198] Created new table in HMS catalog
0619 13:50:45.157837 (+ 8940us) catalog_manager.cc:2232] Wrote table and tablets to system table
0619 13:50:45.157953 (+ 116us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0619 13:50:45.158065 (+ 112us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 13:50:45.149923 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 13:50:45.150071 (+ 148us) write_op.cc:432] Acquiring schema lock in shared mode
0619 13:50:45.150078 (+ 7us) write_op.cc:435] Acquired schema lock
0619 13:50:45.150080 (+ 2us) tablet.cc:662] Decoding operations
0619 13:50:45.150192 (+ 112us) write_op.cc:620] Acquiring the partition lock for write op
0619 13:50:45.150208 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0619 13:50:45.150214 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0619 13:50:45.150298 (+ 84us) tablet.cc:701] Row locks acquired
0619 13:50:45.150300 (+ 2us) write_op.cc:260] PREPARE: finished
0619 13:50:45.150344 (+ 44us) write_op.cc:270] Start()
0619 13:50:45.150379 (+ 35us) write_op.cc:276] Timestamp: P: 1781877045150321 usec, L: 0
0619 13:50:45.150383 (+ 4us) op_driver.cc:348] REPLICATION: starting
0619 13:50:45.150589 (+ 206us) log.cc:844] Serialized 432 byte log entry
0619 13:50:45.156374 (+ 5785us) op_driver.cc:464] REPLICATION: finished
0619 13:50:45.156523 (+ 149us) write_op.cc:301] APPLY: starting
0619 13:50:45.156542 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0619 13:50:45.156591 (+ 49us) tablet.cc:1370] finished BulkCheckPresence
0619 13:50:45.156641 (+ 50us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 13:50:45.156794 (+ 153us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 13:50:45.156836 (+ 42us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0619 13:50:45.156844 (+ 8us) write_op.cc:312] APPLY: finished
0619 13:50:45.156939 (+ 95us) log.cc:844] Serialized 28 byte log entry
0619 13:50:45.157012 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
0619 13:50:45.157054 (+ 42us) write_op.cc:454] Released schema lock
0619 13:50:45.157061 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0619 13:50:45.157150 (+ 89us) write_op.cc:489] Releasing partition, row and schema locks
0619 13:50:45.157154 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1137645,"Hive Metastore.run_cpu_time_us":305,"Hive Metastore.run_wall_time_us":189293,"spinlock_wait_cycles":9523712,"child_traces":[["op",{"apply.queue_time_us":89,"apply.run_cpu_time_us":609,"apply.run_wall_time_us":609,"num_ops":2,"prepare.queue_time_us":133,"prepare.run_cpu_time_us":801,"prepare.run_wall_time_us":802,"raft.queue_time_us":1030,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":297,"replication_time_us":5952}]]}
I20260619 13:50:45.160216 1474 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.84:41509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:39807
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.125:37003
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.105.125
--webserver_port=36357
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 19 Jun 2026 13:43:23 UTC on bdcb31816ec0
build id 12470
ASAN enabled
I20260619 13:50:45.162484 1474 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 13:50:45.165028 1474 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260619 13:50:45.167683 1046 tablet_service.cc:1511] Processing CreateTablet for tablet bf536238326544e7ba59cc441da29696 (DEFAULT_TABLE table=default.table_08f0dacfa3d348c9ab0e8387f52e681a [id=7774d59813b44a19864817d47194e724]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:45.168159 1046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf536238326544e7ba59cc441da29696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:45.168655 1322 tablet_service.cc:1511] Processing CreateTablet for tablet bf536238326544e7ba59cc441da29696 (DEFAULT_TABLE table=default.table_08f0dacfa3d348c9ab0e8387f52e681a [id=7774d59813b44a19864817d47194e724]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:45.169138 1322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf536238326544e7ba59cc441da29696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:45.170395 1184 tablet_service.cc:1511] Processing CreateTablet for tablet bf536238326544e7ba59cc441da29696 (DEFAULT_TABLE table=default.table_08f0dacfa3d348c9ab0e8387f52e681a [id=7774d59813b44a19864817d47194e724]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:45.170851 1184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf536238326544e7ba59cc441da29696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:45.184547 1462 tablet_bootstrap.cc:492] T bf536238326544e7ba59cc441da29696 P 380c26fd105f454cbe8ef6b87e35f41f: Bootstrap starting.
I20260619 13:50:45.188689 1462 tablet_bootstrap.cc:654] T bf536238326544e7ba59cc441da29696 P 380c26fd105f454cbe8ef6b87e35f41f: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:45.196043 870 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49906:
name: "default.Table_387aecac34f04c43a7bf701eff348112"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 13:50:45.197358 1518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 13:50:45.198325 1462 tablet_bootstrap.cc:492] T bf536238326544e7ba59cc441da29696 P 380c26fd105f454cbe8ef6b87e35f41f: No bootstrap required, opened a new log
I20260619 13:50:45.198520 1462 ts_tablet_manager.cc:1403] T bf536238326544e7ba59cc441da29696 P 380c26fd105f454cbe8ef6b87e35f41f: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.000s
I20260619 13:50:45.199541 1462 raft_consensus.cc:359] T bf536238326544e7ba59cc441da29696 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:45.199800 1462 raft_consensus.cc:385] T bf536238326544e7ba59cc441da29696 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:45.199904 1462 raft_consensus.cc:740] T bf536238326544e7ba59cc441da29696 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 380c26fd105f454cbe8ef6b87e35f41f, State: Initialized, Role: FOLLOWER
W20260619 13:50:45.200055 1519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 13:50:45.200245 1462 consensus_queue.cc:260] T bf536238326544e7ba59cc441da29696 P 380c26fd105f454cbe8ef6b87e35f41f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:45.200821 1462 ts_tablet_manager.cc:1434] T bf536238326544e7ba59cc441da29696 P 380c26fd105f454cbe8ef6b87e35f41f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260619 13:50:45.202199 1522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 13:50:45.204277 1474 server_base.cc:1061] running on GCE node
I20260619 13:50:45.205217 1474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 13:50:45.206895 1474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 13:50:45.208184 1474 hybrid_clock.cc:648] HybridClock initialized: now 1781877045208122 us; error 54 us; skew 500 ppm
I20260619 13:50:45.208572 1474 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 13:50:45.211704 1474 webserver.cc:533] Webserver started at http://127.0.105.125:36357/ using document root <none> and password file <none>
I20260619 13:50:45.212587 1474 fs_manager.cc:362] Metadata directory not provided
I20260619 13:50:45.212730 1474 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 13:50:45.218812 1474 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260619 13:50:45.221943 1528 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 13:50:45.223524 1474 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 13:50:45.223722 1474 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data,/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/wal
uuid: "fe5c828398bf4cd592f4a0b084a304b7"
format_stamp: "Formatted at 2026-06-19 13:50:40 on dist-test-slave-7hnr"
I20260619 13:50:45.224484 1474 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 13:50:45.243799 1342 raft_consensus.cc:2468] T afd1f4707bec4f61b6001eb88426f985 P d54f30d62f034b35a8e73ff525ba43d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 380c26fd105f454cbe8ef6b87e35f41f in term 1.
I20260619 13:50:45.243968 1205 raft_consensus.cc:2468] T afd1f4707bec4f61b6001eb88426f985 P 94599283b9334819b3bbe25509b7cd16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 380c26fd105f454cbe8ef6b87e35f41f in term 1.
I20260619 13:50:45.244639 1002 leader_election.cc:304] T afd1f4707bec4f61b6001eb88426f985 P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f, 94599283b9334819b3bbe25509b7cd16; no voters:
I20260619 13:50:45.244987 1497 raft_consensus.cc:2804] T afd1f4707bec4f61b6001eb88426f985 P 380c26fd105f454cbe8ef6b87e35f41f [term 1 FOLLOWER]: Leader election won for term 1
I20260619 13:50:45.247114 1463 tablet_bootstrap.cc:492] T bf536238326544e7ba59cc441da29696 P d54f30d62f034b35a8e73ff525ba43d9: Bootstrap starting.
I20260619 13:50:45.247478 1461 tablet_bootstrap.cc:492] T bf536238326544e7ba59cc441da29696 P 94599283b9334819b3bbe25509b7cd16: Bootstrap starting.
I20260619 13:50:45.248768 1463 tablet_bootstrap.cc:654] T bf536238326544e7ba59cc441da29696 P d54f30d62f034b35a8e73ff525ba43d9: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:45.249795 1461 tablet_bootstrap.cc:654] T bf536238326544e7ba59cc441da29696 P 94599283b9334819b3bbe25509b7cd16: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:45.261323 1463 tablet_bootstrap.cc:492] T bf536238326544e7ba59cc441da29696 P d54f30d62f034b35a8e73ff525ba43d9: No bootstrap required, opened a new log
I20260619 13:50:45.261348 1497 raft_consensus.cc:697] T afd1f4707bec4f61b6001eb88426f985 P 380c26fd105f454cbe8ef6b87e35f41f [term 1 LEADER]: Becoming Leader. State: Replica: 380c26fd105f454cbe8ef6b87e35f41f, State: Running, Role: LEADER
I20260619 13:50:45.261724 1463 ts_tablet_manager.cc:1403] T bf536238326544e7ba59cc441da29696 P d54f30d62f034b35a8e73ff525ba43d9: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.008s
I20260619 13:50:45.261795 1461 tablet_bootstrap.cc:492] T bf536238326544e7ba59cc441da29696 P 94599283b9334819b3bbe25509b7cd16: No bootstrap required, opened a new log
I20260619 13:50:45.261744 1497 consensus_queue.cc:237] T afd1f4707bec4f61b6001eb88426f985 P 380c26fd105f454cbe8ef6b87e35f41f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } }
I20260619 13:50:45.261945 1461 ts_tablet_manager.cc:1403] T bf536238326544e7ba59cc441da29696 P 94599283b9334819b3bbe25509b7cd16: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.004s
I20260619 13:50:45.262811 1461 raft_consensus.cc:359] T bf536238326544e7ba59cc441da29696 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:45.262966 1474 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260619 13:50:45.263011 1461 raft_consensus.cc:385] T bf536238326544e7ba59cc441da29696 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:45.263108 1461 raft_consensus.cc:740] T bf536238326544e7ba59cc441da29696 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94599283b9334819b3bbe25509b7cd16, State: Initialized, Role: FOLLOWER
I20260619 13:50:45.262914 1463 raft_consensus.cc:359] T bf536238326544e7ba59cc441da29696 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:45.263329 1463 raft_consensus.cc:385] T bf536238326544e7ba59cc441da29696 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:45.263372 1461 consensus_queue.cc:260] T bf536238326544e7ba59cc441da29696 P 94599283b9334819b3bbe25509b7cd16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:45.263464 1463 raft_consensus.cc:740] T bf536238326544e7ba59cc441da29696 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f30d62f034b35a8e73ff525ba43d9, State: Initialized, Role: FOLLOWER
I20260619 13:50:45.264161 1474 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 13:50:45.264472 1474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 13:50:45.265223 1463 consensus_queue.cc:260] T bf536238326544e7ba59cc441da29696 P d54f30d62f034b35a8e73ff525ba43d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:45.266455 1461 ts_tablet_manager.cc:1434] T bf536238326544e7ba59cc441da29696 P 94599283b9334819b3bbe25509b7cd16: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260619 13:50:45.271243 1463 ts_tablet_manager.cc:1434] T bf536238326544e7ba59cc441da29696 P d54f30d62f034b35a8e73ff525ba43d9: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260619 13:50:45.287949 1473 consensus_queue.cc:1048] T 81c901680eb84fe7ae5957ca045f2d69 P d54f30d62f034b35a8e73ff525ba43d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 13:50:45.300330 1585 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.125:37003 every 8 connection(s)
I20260619 13:50:45.300561 1474 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.125:37003
I20260619 13:50:45.303193 1474 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data/info.pb
I20260619 13:50:45.304200 1467 consensus_queue.cc:1048] T 81c901680eb84fe7ae5957ca045f2d69 P d54f30d62f034b35a8e73ff525ba43d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 13:50:45.310509 421 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu as pid 1474
I20260619 13:50:45.322022 1587 sys_catalog.cc:263] Verifying existing consensus state
I20260619 13:50:45.328866 1587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: Bootstrap starting.
I20260619 13:50:45.345037 1587 log.cc:826] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: Log is configured to *not* fsync() on all Append() calls
I20260619 13:50:45.348109 869 catalog_manager.cc:2199] created HMS catalog entry for table [id=8385a644150b489d9d4f61e2338d081e]
I20260619 13:50:45.355960 869 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:49906 (request call id 22) took 1563 ms. Trace:
I20260619 13:50:45.356110 869 rpcz_store.cc:276] 0619 13:50:43.792464 (+ 0us) service_pool.cc:167] Inserting onto call queue
0619 13:50:43.793169 (+ 705us) service_pool.cc:224] Handling call
0619 13:50:43.796721 (+ 3552us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x617000007ce0. stack: 00007fcf0ec99496 00007fcf0ec99250 00007fcf0dcc43ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fcf0ec8ef2d 00007fcf0ec8fd6e 00007fcf22b836cd 00007fcf22ae9c48 00007fcf22aa74c8 00007fcf22c3a6c3 00007fcf196967c6 00007fcf196964f5 00007fcf15da388e 00007fcf15da276e
0619 13:50:43.803204 (+ 6483us) spinlock_profiling.cc:243] Waited 6.24 ms on lock 0x616000041b54. stack: 00007fcf0ec99496 00007fcf0ec99250 00007fcf0dcc43ad 000000000099c914 000000000099c8dd 00007fcf1e17a6bd 00007fcf1e17a7b3 00007fcf1ad42b21 00007fcf22aa795d 00007fcf22c3a6c3 00007fcf196967c6 00007fcf196964f5 00007fcf15da388e 00007fcf15da276e 00007fcf15da89a8 00007fcf15da930f
0619 13:50:43.822355 (+ 19151us) catalog_manager.cc:2126] Acquired catalog manager lock
0619 13:50:43.822801 (+ 446us) catalog_manager.cc:2172] Created new table and tablet info
0619 13:50:45.348057 (+1525256us) catalog_manager.cc:2198] Created new table in HMS catalog
0619 13:50:45.355693 (+ 7636us) catalog_manager.cc:2232] Wrote table and tablets to system table
0619 13:50:45.355806 (+ 113us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0619 13:50:45.355919 (+ 113us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0619 13:50:45.349036 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0619 13:50:45.349177 (+ 141us) write_op.cc:432] Acquiring schema lock in shared mode
0619 13:50:45.349198 (+ 21us) write_op.cc:435] Acquired schema lock
0619 13:50:45.349201 (+ 3us) tablet.cc:662] Decoding operations
0619 13:50:45.349319 (+ 118us) write_op.cc:620] Acquiring the partition lock for write op
0619 13:50:45.349335 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0619 13:50:45.349341 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0619 13:50:45.349433 (+ 92us) tablet.cc:701] Row locks acquired
0619 13:50:45.349437 (+ 4us) write_op.cc:260] PREPARE: finished
0619 13:50:45.349486 (+ 49us) write_op.cc:270] Start()
0619 13:50:45.349554 (+ 68us) write_op.cc:276] Timestamp: P: 1781877045349358 usec, L: 0
0619 13:50:45.349559 (+ 5us) op_driver.cc:348] REPLICATION: starting
0619 13:50:45.349809 (+ 250us) log.cc:844] Serialized 432 byte log entry
0619 13:50:45.354243 (+ 4434us) op_driver.cc:464] REPLICATION: finished
0619 13:50:45.354409 (+ 166us) write_op.cc:301] APPLY: starting
0619 13:50:45.354430 (+ 21us) tablet.cc:1367] starting BulkCheckPresence
0619 13:50:45.354480 (+ 50us) tablet.cc:1370] finished BulkCheckPresence
0619 13:50:45.354506 (+ 26us) tablet.cc:1372] starting ApplyRowOperation cycle
0619 13:50:45.354614 (+ 108us) tablet.cc:1383] finished ApplyRowOperation cycle
0619 13:50:45.354662 (+ 48us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0619 13:50:45.354669 (+ 7us) write_op.cc:312] APPLY: finished
0619 13:50:45.354757 (+ 88us) log.cc:844] Serialized 28 byte log entry
0619 13:50:45.354827 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0619 13:50:45.354850 (+ 23us) write_op.cc:454] Released schema lock
0619 13:50:45.354857 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0619 13:50:45.354929 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0619 13:50:45.354933 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1325982,"Hive Metastore.run_cpu_time_us":302,"Hive Metastore.run_wall_time_us":198940,"spinlock_wait_cycles":16876160,"child_traces":[["op",{"apply.queue_time_us":107,"apply.run_cpu_time_us":514,"apply.run_wall_time_us":514,"num_ops":2,"prepare.queue_time_us":85,"prepare.run_cpu_time_us":909,"prepare.run_wall_time_us":909,"raft.queue_time_us":173,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":317,"replication_time_us":4652}]]}
I20260619 13:50:45.363117 1390 heartbeater.cc:344] Connected to a master server at 127.0.105.125:37003
I20260619 13:50:45.363364 1390 heartbeater.cc:499] Master 127.0.105.125:37003 was elected leader, sending a full tablet report...
I20260619 13:50:45.367242 1587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 13:50:45.367992 1587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: Bootstrap complete.
I20260619 13:50:45.368813 1252 heartbeater.cc:344] Connected to a master server at 127.0.105.125:37003
I20260619 13:50:45.372995 1184 tablet_service.cc:1511] Processing CreateTablet for tablet d7f76b3a50b24ef380870ccd67510d57 (DEFAULT_TABLE table=default.table_71421a29531045198619e2e3d9383268 [id=8385a644150b489d9d4f61e2338d081e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:45.373222 1115 heartbeater.cc:344] Connected to a master server at 127.0.105.125:37003
I20260619 13:50:45.373483 1184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f76b3a50b24ef380870ccd67510d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:45.375998 1587 raft_consensus.cc:359] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:45.376948 1587 raft_consensus.cc:740] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe5c828398bf4cd592f4a0b084a304b7, State: Initialized, Role: FOLLOWER
I20260619 13:50:45.377753 1587 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:45.377900 1322 tablet_service.cc:1511] Processing CreateTablet for tablet d7f76b3a50b24ef380870ccd67510d57 (DEFAULT_TABLE table=default.table_71421a29531045198619e2e3d9383268 [id=8385a644150b489d9d4f61e2338d081e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:45.378368 1322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f76b3a50b24ef380870ccd67510d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:45.383298 1463 tablet_bootstrap.cc:492] T d7f76b3a50b24ef380870ccd67510d57 P d54f30d62f034b35a8e73ff525ba43d9: Bootstrap starting.
F20260619 13:50:45.384371 933 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 1, previous 1; dumping first 2 out of 10 received events: NotificationEvent(eventId=1, eventTime=1781877043, eventType=CREATE_TABLE, dbName=default, tableName=table_2138876d1fe74e81bfc560e2fb592a0e, message={"server":"","servicePrincipal":"","db":"default","table":"table_2138876d1fe74e81bfc560e2fb592a0e","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_2138876d1fe74e81bfc560e2fb592a0e\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1781877043},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/warehouse/table_2138876d1fe74e81bfc560e2fb592a0e\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_2138876d1fe74e81bfc560e2fb592a0e\",\"kudu.table_id\":\"57c8bf0937b84407ace807934df053c4\",\"transient_lastDdlTime\":\"1781877043\",\"comment\":\"\",\"kudu.master_addresses\":\"127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"83fe01e7c5804ae9b7b2307f12c08ec9\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1781877043,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=1, eventTime=1781877043, eventType=CREATE_TABLE, dbName=default, tableName=table_c52ddc84a5e24c718eba7aab2234f558, message={"server":"","servicePrincipal":"","db":"default","table":"table_c52ddc84a5e24c718eba7aab2234f558","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_c52ddc84a5e24c718eba7aab2234f558\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1781877043},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/warehouse/table_c52ddc84a5e24c718eba7aab2234f558\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_c52ddc84a5e24c718eba7aab2234f558\",\"kudu.table_id\":\"b3b37daaec8c448a98386eb208b2cd04\",\"transient_lastDdlTime\":\"1781877043\",\"comment\":\"\",\"kudu.master_addresses\":\"127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"83fe01e7c5804ae9b7b2307f12c08ec9\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1781877043,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20260619 13:50:45.385210 1463 tablet_bootstrap.cc:654] T d7f76b3a50b24ef380870ccd67510d57 P d54f30d62f034b35a8e73ff525ba43d9: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:45.388316 1046 tablet_service.cc:1511] Processing CreateTablet for tablet d7f76b3a50b24ef380870ccd67510d57 (DEFAULT_TABLE table=default.table_71421a29531045198619e2e3d9383268 [id=8385a644150b489d9d4f61e2338d081e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:45.388871 1046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f76b3a50b24ef380870ccd67510d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:45.390549 1596 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:45.390897 1596 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 13:50:45.392089 1587 sys_catalog.cc:565] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 13:50:45.393949 1463 tablet_bootstrap.cc:492] T d7f76b3a50b24ef380870ccd67510d57 P d54f30d62f034b35a8e73ff525ba43d9: No bootstrap required, opened a new log
I20260619 13:50:45.394133 1463 ts_tablet_manager.cc:1403] T d7f76b3a50b24ef380870ccd67510d57 P d54f30d62f034b35a8e73ff525ba43d9: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.008s
I20260619 13:50:45.394948 1463 raft_consensus.cc:359] T d7f76b3a50b24ef380870ccd67510d57 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } }
I20260619 13:50:45.395167 1463 raft_consensus.cc:385] T d7f76b3a50b24ef380870ccd67510d57 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:45.395246 1463 raft_consensus.cc:740] T d7f76b3a50b24ef380870ccd67510d57 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f30d62f034b35a8e73ff525ba43d9, State: Initialized, Role: FOLLOWER
I20260619 13:50:45.395562 1463 consensus_queue.cc:260] T d7f76b3a50b24ef380870ccd67510d57 P d54f30d62f034b35a8e73ff525ba43d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } }
I20260619 13:50:45.396680 1390 heartbeater.cc:499] Master 127.0.105.125:37003 was elected leader, sending a full tablet report...
@ 0x7fcf0bf97dcd google::LogMessage::Fail() at ??:0
@ 0x7fcf0bf9bb93 google::LogMessage::SendToLog() at ??:0
I20260619 13:50:45.399614 1462 tablet_bootstrap.cc:492] T d7f76b3a50b24ef380870ccd67510d57 P 380c26fd105f454cbe8ef6b87e35f41f: Bootstrap starting.
@ 0x7fcf0bf977cc google::LogMessage::Flush() at ??:0
I20260619 13:50:45.401939 1462 tablet_bootstrap.cc:654] T d7f76b3a50b24ef380870ccd67510d57 P 380c26fd105f454cbe8ef6b87e35f41f: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:45.402263 1463 ts_tablet_manager.cc:1434] T d7f76b3a50b24ef380870ccd67510d57 P d54f30d62f034b35a8e73ff525ba43d9: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260619 13:50:45.405242 1390 heartbeater.cc:499] Master 127.0.105.125:37003 was elected leader, sending a full tablet report...
I20260619 13:50:45.412393 1462 tablet_bootstrap.cc:492] T d7f76b3a50b24ef380870ccd67510d57 P 380c26fd105f454cbe8ef6b87e35f41f: No bootstrap required, opened a new log
I20260619 13:50:45.412568 1462 ts_tablet_manager.cc:1403] T d7f76b3a50b24ef380870ccd67510d57 P 380c26fd105f454cbe8ef6b87e35f41f: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.001s
I20260619 13:50:45.413200 1462 raft_consensus.cc:359] T d7f76b3a50b24ef380870ccd67510d57 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } }
I20260619 13:50:45.413352 1462 raft_consensus.cc:385] T d7f76b3a50b24ef380870ccd67510d57 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:45.413396 1462 raft_consensus.cc:740] T d7f76b3a50b24ef380870ccd67510d57 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 380c26fd105f454cbe8ef6b87e35f41f, State: Initialized, Role: FOLLOWER
I20260619 13:50:45.413687 1462 consensus_queue.cc:260] T d7f76b3a50b24ef380870ccd67510d57 P 380c26fd105f454cbe8ef6b87e35f41f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } }
I20260619 13:50:45.414211 1462 ts_tablet_manager.cc:1434] T d7f76b3a50b24ef380870ccd67510d57 P 380c26fd105f454cbe8ef6b87e35f41f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 13:50:45.414521 1461 tablet_bootstrap.cc:492] T d7f76b3a50b24ef380870ccd67510d57 P 94599283b9334819b3bbe25509b7cd16: Bootstrap starting.
I20260619 13:50:45.416483 1461 tablet_bootstrap.cc:654] T d7f76b3a50b24ef380870ccd67510d57 P 94599283b9334819b3bbe25509b7cd16: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:45.417297 869 catalog_manager.cc:5696] T afd1f4707bec4f61b6001eb88426f985 P 380c26fd105f454cbe8ef6b87e35f41f reported cstate change: term changed from 0 to 1, leader changed from <none> to 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65). New cstate: current_term: 1 leader_uuid: "380c26fd105f454cbe8ef6b87e35f41f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } health_report { overall_health: UNKNOWN } } }
@ 0x7fcf0bf97a11 google::LogMessage::~LogMessage() at ??:0
I20260619 13:50:45.423656 1461 tablet_bootstrap.cc:492] T d7f76b3a50b24ef380870ccd67510d57 P 94599283b9334819b3bbe25509b7cd16: No bootstrap required, opened a new log
I20260619 13:50:45.423866 1461 ts_tablet_manager.cc:1403] T d7f76b3a50b24ef380870ccd67510d57 P 94599283b9334819b3bbe25509b7cd16: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.001s
I20260619 13:50:45.424783 1461 raft_consensus.cc:359] T d7f76b3a50b24ef380870ccd67510d57 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } }
I20260619 13:50:45.425009 1461 raft_consensus.cc:385] T d7f76b3a50b24ef380870ccd67510d57 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:45.425081 1461 raft_consensus.cc:740] T d7f76b3a50b24ef380870ccd67510d57 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94599283b9334819b3bbe25509b7cd16, State: Initialized, Role: FOLLOWER
I20260619 13:50:45.425391 1461 consensus_queue.cc:260] T d7f76b3a50b24ef380870ccd67510d57 P 94599283b9334819b3bbe25509b7cd16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } }
I20260619 13:50:45.429630 1497 consensus_queue.cc:1048] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f [LEADER]: Connected to new peer: Peer: permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 13:50:45.431603 1461 ts_tablet_manager.cc:1434] T d7f76b3a50b24ef380870ccd67510d57 P 94599283b9334819b3bbe25509b7cd16: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260619 13:50:45.446028 1533 consensus_queue.cc:1048] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 13:50:45.448386 1390 heartbeater.cc:499] Master 127.0.105.125:37003 was elected leader, sending a full tablet report...
@ 0x7fcf22b92394 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7fcf22b90c41 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260619 13:50:45.466270 869 master_service.cc:960] ReplaceTablet: received request to replace tablet 0fd56579c7a44155a0090e2720566a58 from {username='slave'} at 127.0.0.1:49906
@ 0x7fcf22b988bc kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7fcf22b98739 std::_Function_handler<>::_M_invoke() at ??:0
I20260619 13:50:45.476857 1390 heartbeater.cc:499] Master 127.0.105.125:37003 was elected leader, sending a full tablet report...
I20260619 13:50:45.479754 1482 raft_consensus.cc:493] T bf536238326544e7ba59cc441da29696 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:50:45.480001 1482 raft_consensus.cc:515] T bf536238326544e7ba59cc441da29696 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:45.480973 1482 leader_election.cc:290] T bf536238326544e7ba59cc441da29696 P 94599283b9334819b3bbe25509b7cd16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
@ 0xaa681d std::function<>::operator()() at ??:?
I20260619 13:50:45.481957 1342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf536238326544e7ba59cc441da29696" candidate_uuid: "94599283b9334819b3bbe25509b7cd16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f30d62f034b35a8e73ff525ba43d9" is_pre_election: true
I20260619 13:50:45.482281 1342 raft_consensus.cc:2468] T bf536238326544e7ba59cc441da29696 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94599283b9334819b3bbe25509b7cd16 in term 0.
I20260619 13:50:45.483523 1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf536238326544e7ba59cc441da29696" candidate_uuid: "94599283b9334819b3bbe25509b7cd16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "380c26fd105f454cbe8ef6b87e35f41f" is_pre_election: true
I20260619 13:50:45.483816 1068 raft_consensus.cc:2468] T bf536238326544e7ba59cc441da29696 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94599283b9334819b3bbe25509b7cd16 in term 0.
I20260619 13:50:45.484512 1141 leader_election.cc:304] T bf536238326544e7ba59cc441da29696 P 94599283b9334819b3bbe25509b7cd16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9; no voters:
I20260619 13:50:45.485654 1482 raft_consensus.cc:2804] T bf536238326544e7ba59cc441da29696 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 13:50:45.485817 1482 raft_consensus.cc:493] T bf536238326544e7ba59cc441da29696 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 13:50:45.485921 1482 raft_consensus.cc:3060] T bf536238326544e7ba59cc441da29696 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Advancing to term 1
@ 0x7fcf0ecbef49 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fcf123886db start_thread at ??:0
I20260619 13:50:45.490684 869 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: Sending DeleteTablet for 3 replicas of tablet 0fd56579c7a44155a0090e2720566a58
@ 0x7fcf0ae4661f clone at ??:0
I20260619 13:50:45.491981 1046 tablet_service.cc:1558] Processing DeleteTablet for tablet 0fd56579c7a44155a0090e2720566a58 with delete_type TABLET_DATA_DELETED (replaced by tablet e637f2b405c445a1afee9cd9c9db8d08) from {username='slave'} at 127.0.0.1:47424
I20260619 13:50:45.492758 1612 tablet_replica.cc:333] T 0fd56579c7a44155a0090e2720566a58 P 380c26fd105f454cbe8ef6b87e35f41f: stopping tablet replica
I20260619 13:50:45.493005 1612 raft_consensus.cc:2243] T 0fd56579c7a44155a0090e2720566a58 P 380c26fd105f454cbe8ef6b87e35f41f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 13:50:45.493225 1612 raft_consensus.cc:2272] T 0fd56579c7a44155a0090e2720566a58 P 380c26fd105f454cbe8ef6b87e35f41f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 13:50:45.493934 1612 ts_tablet_manager.cc:1916] T 0fd56579c7a44155a0090e2720566a58 P 380c26fd105f454cbe8ef6b87e35f41f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 13:50:45.498317 1533 consensus_queue.cc:1048] T d66b1eaa29454bb3bc8e2c493d01cb43 P 380c26fd105f454cbe8ef6b87e35f41f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 13:50:45.500365 1390 heartbeater.cc:499] Master 127.0.105.125:37003 was elected leader, sending a full tablet report...
I20260619 13:50:45.507045 1497 consensus_queue.cc:1048] T d66b1eaa29454bb3bc8e2c493d01cb43 P 380c26fd105f454cbe8ef6b87e35f41f [LEADER]: Connected to new peer: Peer: permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 13:50:45.510079 1390 heartbeater.cc:499] Master 127.0.105.125:37003 was elected leader, sending a full tablet report...
I20260619 13:50:45.531133 1627 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260619 13:50:45.546469 1482 raft_consensus.cc:515] T bf536238326544e7ba59cc441da29696 P 94599283b9334819b3bbe25509b7cd16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:45.547256 1482 leader_election.cc:290] T bf536238326544e7ba59cc441da29696 P 94599283b9334819b3bbe25509b7cd16 [CANDIDATE]: Term 1 election: Requested vote from peers 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
I20260619 13:50:45.549479 1342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf536238326544e7ba59cc441da29696" candidate_uuid: "94599283b9334819b3bbe25509b7cd16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f30d62f034b35a8e73ff525ba43d9"
I20260619 13:50:45.549752 1342 raft_consensus.cc:3060] T bf536238326544e7ba59cc441da29696 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:45.550899 1549 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "94599283b9334819b3bbe25509b7cd16" instance_seqno: 1781877042768620) as {username='slave'} at 127.0.105.66:40955; Asking this server to re-register.
I20260619 13:50:45.552824 1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf536238326544e7ba59cc441da29696" candidate_uuid: "94599283b9334819b3bbe25509b7cd16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "380c26fd105f454cbe8ef6b87e35f41f"
I20260619 13:50:45.553027 1068 raft_consensus.cc:3060] T bf536238326544e7ba59cc441da29696 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:45.553064 1252 heartbeater.cc:461] Registering TS with master...
I20260619 13:50:45.555804 1549 ts_manager.cc:194] Registered new tserver with Master: 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481)
I20260619 13:50:45.594031 1612 ts_tablet_manager.cc:1929] T 0fd56579c7a44155a0090e2720566a58 P 380c26fd105f454cbe8ef6b87e35f41f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260619 13:50:45.593947 1342 raft_consensus.cc:2468] T bf536238326544e7ba59cc441da29696 P d54f30d62f034b35a8e73ff525ba43d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94599283b9334819b3bbe25509b7cd16 in term 1.
I20260619 13:50:45.594187 1612 log.cc:1199] T 0fd56579c7a44155a0090e2720566a58 P 380c26fd105f454cbe8ef6b87e35f41f: Deleting WAL directory at /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-0/wal/wals/0fd56579c7a44155a0090e2720566a58
I20260619 13:50:45.594693 1612 ts_tablet_manager.cc:1950] T 0fd56579c7a44155a0090e2720566a58 P 380c26fd105f454cbe8ef6b87e35f41f: Deleting consensus metadata
I20260619 13:50:45.594686 1068 raft_consensus.cc:2468] T bf536238326544e7ba59cc441da29696 P 380c26fd105f454cbe8ef6b87e35f41f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94599283b9334819b3bbe25509b7cd16 in term 1.
I20260619 13:50:45.595404 1140 leader_election.cc:304] T bf536238326544e7ba59cc441da29696 P 94599283b9334819b3bbe25509b7cd16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f, 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9; no voters:
I20260619 13:50:45.595790 1482 raft_consensus.cc:2804] T bf536238326544e7ba59cc441da29696 P 94599283b9334819b3bbe25509b7cd16 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 13:50:45.595922 1482 raft_consensus.cc:697] T bf536238326544e7ba59cc441da29696 P 94599283b9334819b3bbe25509b7cd16 [term 1 LEADER]: Becoming Leader. State: Replica: 94599283b9334819b3bbe25509b7cd16, State: Running, Role: LEADER
I20260619 13:50:45.596279 1482 consensus_queue.cc:237] T bf536238326544e7ba59cc441da29696 P 94599283b9334819b3bbe25509b7cd16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:45.605764 1467 raft_consensus.cc:493] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:50:45.605978 1467 raft_consensus.cc:515] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } }
I20260619 13:50:45.606851 1467 leader_election.cc:290] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865), 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481)
I20260619 13:50:45.607455 1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72a70b85f464558a625e293380f610b" candidate_uuid: "d54f30d62f034b35a8e73ff525ba43d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "380c26fd105f454cbe8ef6b87e35f41f" is_pre_election: true
I20260619 13:50:45.607743 1068 raft_consensus.cc:2468] T c72a70b85f464558a625e293380f610b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f30d62f034b35a8e73ff525ba43d9 in term 0.
I20260619 13:50:45.608206 1621 raft_consensus.cc:493] T d7f76b3a50b24ef380870ccd67510d57 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:50:45.608304 1278 leader_election.cc:304] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f, d54f30d62f034b35a8e73ff525ba43d9; no voters:
I20260619 13:50:45.608381 1621 raft_consensus.cc:515] T d7f76b3a50b24ef380870ccd67510d57 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } }
I20260619 13:50:45.609102 1621 leader_election.cc:290] T d7f76b3a50b24ef380870ccd67510d57 P 94599283b9334819b3bbe25509b7cd16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847), 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865)
I20260619 13:50:45.609807 1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72a70b85f464558a625e293380f610b" candidate_uuid: "d54f30d62f034b35a8e73ff525ba43d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94599283b9334819b3bbe25509b7cd16" is_pre_election: true
I20260619 13:50:45.610028 1205 raft_consensus.cc:2468] T c72a70b85f464558a625e293380f610b P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f30d62f034b35a8e73ff525ba43d9 in term 0.
I20260619 13:50:45.610643 1342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76b3a50b24ef380870ccd67510d57" candidate_uuid: "94599283b9334819b3bbe25509b7cd16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f30d62f034b35a8e73ff525ba43d9" is_pre_election: true
I20260619 13:50:45.610858 1342 raft_consensus.cc:2468] T d7f76b3a50b24ef380870ccd67510d57 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94599283b9334819b3bbe25509b7cd16 in term 0.
I20260619 13:50:45.610822 1621 consensus_queue.cc:1048] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 13:50:45.611245 1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76b3a50b24ef380870ccd67510d57" candidate_uuid: "94599283b9334819b3bbe25509b7cd16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "380c26fd105f454cbe8ef6b87e35f41f" is_pre_election: true
I20260619 13:50:45.611456 1068 raft_consensus.cc:2468] T d7f76b3a50b24ef380870ccd67510d57 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94599283b9334819b3bbe25509b7cd16 in term 0.
I20260619 13:50:45.611969 1140 leader_election.cc:304] T d7f76b3a50b24ef380870ccd67510d57 P 94599283b9334819b3bbe25509b7cd16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f, 94599283b9334819b3bbe25509b7cd16; no voters:
I20260619 13:50:45.612506 1621 raft_consensus.cc:2804] T d7f76b3a50b24ef380870ccd67510d57 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 13:50:45.612596 1621 raft_consensus.cc:493] T d7f76b3a50b24ef380870ccd67510d57 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 13:50:45.612671 1473 raft_consensus.cc:2804] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 13:50:45.612694 1621 raft_consensus.cc:3060] T d7f76b3a50b24ef380870ccd67510d57 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:45.612787 1473 raft_consensus.cc:493] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 13:50:45.612864 1473 raft_consensus.cc:3060] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:45.617208 1390 heartbeater.cc:344] Connected to a master server at 127.0.105.125:37003
I20260619 13:50:45.617444 1390 heartbeater.cc:499] Master 127.0.105.125:37003 was elected leader, sending a full tablet report...
I20260619 13:50:45.624868 1639 consensus_queue.cc:1048] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 13:50:45.629073 1549 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" instance_seqno: 1781877042220212) as {username='slave'} at 127.0.105.65:33195; Asking this server to re-register.
I20260619 13:50:45.629863 1115 heartbeater.cc:461] Registering TS with master...
I20260619 13:50:45.632138 1549 ts_manager.cc:194] Registered new tserver with Master: 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865)
I20260619 13:50:45.640878 1621 raft_consensus.cc:515] T d7f76b3a50b24ef380870ccd67510d57 P 94599283b9334819b3bbe25509b7cd16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } }
I20260619 13:50:45.640897 1473 raft_consensus.cc:515] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } }
I20260619 13:50:45.641726 1621 leader_election.cc:290] T d7f76b3a50b24ef380870ccd67510d57 P 94599283b9334819b3bbe25509b7cd16 [CANDIDATE]: Term 1 election: Requested vote from peers d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847), 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865)
I20260619 13:50:45.641713 1473 leader_election.cc:290] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9 [CANDIDATE]: Term 1 election: Requested vote from peers 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865), 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481)
I20260619 13:50:45.642251 1342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76b3a50b24ef380870ccd67510d57" candidate_uuid: "94599283b9334819b3bbe25509b7cd16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f30d62f034b35a8e73ff525ba43d9"
I20260619 13:50:45.642469 1342 raft_consensus.cc:3060] T d7f76b3a50b24ef380870ccd67510d57 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:45.642450 1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72a70b85f464558a625e293380f610b" candidate_uuid: "d54f30d62f034b35a8e73ff525ba43d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "380c26fd105f454cbe8ef6b87e35f41f"
I20260619 13:50:45.642688 1068 raft_consensus.cc:3060] T c72a70b85f464558a625e293380f610b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:45.643747 1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72a70b85f464558a625e293380f610b" candidate_uuid: "d54f30d62f034b35a8e73ff525ba43d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94599283b9334819b3bbe25509b7cd16"
I20260619 13:50:45.643967 1205 raft_consensus.cc:3060] T c72a70b85f464558a625e293380f610b P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:45.644014 1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76b3a50b24ef380870ccd67510d57" candidate_uuid: "94599283b9334819b3bbe25509b7cd16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "380c26fd105f454cbe8ef6b87e35f41f"
I20260619 13:50:45.644299 1067 raft_consensus.cc:3060] T d7f76b3a50b24ef380870ccd67510d57 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:45.646529 1549 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" instance_seqno: 1781877043287674) as {username='slave'} at 127.0.105.67:53641; Asking this server to re-register.
I20260619 13:50:45.647393 1390 heartbeater.cc:461] Registering TS with master...
I20260619 13:50:45.649035 1549 ts_manager.cc:194] Registered new tserver with Master: d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
I20260619 13:50:45.690424 1205 raft_consensus.cc:2468] T c72a70b85f464558a625e293380f610b P 94599283b9334819b3bbe25509b7cd16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f30d62f034b35a8e73ff525ba43d9 in term 1.
I20260619 13:50:45.690469 1342 raft_consensus.cc:2468] T d7f76b3a50b24ef380870ccd67510d57 P d54f30d62f034b35a8e73ff525ba43d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94599283b9334819b3bbe25509b7cd16 in term 1.
I20260619 13:50:45.691094 1277 leader_election.cc:304] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9; no voters:
I20260619 13:50:45.691777 1473 raft_consensus.cc:2804] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 13:50:45.691958 1473 raft_consensus.cc:697] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9 [term 1 LEADER]: Becoming Leader. State: Replica: d54f30d62f034b35a8e73ff525ba43d9, State: Running, Role: LEADER
I20260619 13:50:45.692296 1473 consensus_queue.cc:237] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } }
I20260619 13:50:45.692801 1141 leader_election.cc:304] T d7f76b3a50b24ef380870ccd67510d57 P 94599283b9334819b3bbe25509b7cd16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9; no voters:
I20260619 13:50:45.693356 1621 raft_consensus.cc:2804] T d7f76b3a50b24ef380870ccd67510d57 P 94599283b9334819b3bbe25509b7cd16 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 13:50:45.693568 1621 raft_consensus.cc:697] T d7f76b3a50b24ef380870ccd67510d57 P 94599283b9334819b3bbe25509b7cd16 [term 1 LEADER]: Becoming Leader. State: Replica: 94599283b9334819b3bbe25509b7cd16, State: Running, Role: LEADER
I20260619 13:50:45.693817 1068 raft_consensus.cc:2468] T c72a70b85f464558a625e293380f610b P 380c26fd105f454cbe8ef6b87e35f41f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f30d62f034b35a8e73ff525ba43d9 in term 1.
I20260619 13:50:45.693852 1621 consensus_queue.cc:237] T d7f76b3a50b24ef380870ccd67510d57 P 94599283b9334819b3bbe25509b7cd16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } }
I20260619 13:50:45.737219 1067 raft_consensus.cc:2468] T d7f76b3a50b24ef380870ccd67510d57 P 380c26fd105f454cbe8ef6b87e35f41f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94599283b9334819b3bbe25509b7cd16 in term 1.
W20260619 13:50:45.775560 1002 connection.cc:573] server connection from 127.0.0.1:47424 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 13:50:45.775629 1395 connection.cc:573] client connection to 127.0.105.124:40279 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 13:50:45.776407 1395 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.105.124:40279)
W20260619 13:50:45.776582 1001 connection.cc:573] client connection to 127.0.105.124:40279 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 13:50:45.776906 1395 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.105.124:40279)
W20260619 13:50:45.777343 1138 connection.cc:573] client connection to 127.0.105.124:40279 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 13:50:45.777755 1632 negotiation.cc:336] Failed RPC negotiation. Trace:
0619 13:50:45.586039 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.0.105.124:40279 (local address 127.0.0.1:49912)
0619 13:50:45.587006 (+ 967us) negotiation.cc:107] Waiting for socket to connect
0619 13:50:45.587026 (+ 20us) client_negotiation.cc:175] Beginning negotiation
0619 13:50:45.587148 (+ 122us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0619 13:50:45.776128 (+188980us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":829,"thread_start_us":729,"threads_started":1}
W20260619 13:50:45.784718 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 1: this message will repeat every 5th retry.
I20260619 13:50:45.779147 1474 master_runner.cc:187] Error getting master registration for 127.0.105.124:40279: Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107),
I20260619 13:50:45.786064 1474 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:50:45.786573 1395 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.105.124:40279)
W20260619 13:50:45.787281 1395 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.105.124:40279)
I20260619 13:50:45.907565 1644 raft_consensus.cc:493] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:50:45.908030 1644 raft_consensus.cc:515] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:45.910524 1644 leader_election.cc:290] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
I20260619 13:50:45.911113 746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fe5c828398bf4cd592f4a0b084a304b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7adca601777549878be161a6116e53b6" is_pre_election: true
W20260619 13:50:45.911374 1529 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:50:45.912701 1529 leader_election.cc:336] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:50:45.912873 1529 leader_election.cc:304] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe5c828398bf4cd592f4a0b084a304b7; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, 7adca601777549878be161a6116e53b6
I20260619 13:50:45.913239 1644 raft_consensus.cc:2749] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260619 13:50:45.990469 1646 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6184e94a3ec241bfa8d2e34ea579f8a6)
I20260619 13:50:45.990777 1646 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:45.991744 1646 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:50:45.992871 721 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20260619 13:50:45.994477 721 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:50:45.998863 1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7adca601777549878be161a6116e53b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 33 } } ignore_live_leader: false dest_uuid: "fe5c828398bf4cd592f4a0b084a304b7" is_pre_election: true
I20260619 13:50:45.999334 1559 raft_consensus.cc:2468] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7adca601777549878be161a6116e53b6 in term 1.
I20260619 13:50:45.999858 723 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7adca601777549878be161a6116e53b6, fe5c828398bf4cd592f4a0b084a304b7; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6
I20260619 13:50:46.000201 1646 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260619 13:50:46.000365 1646 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6184e94a3ec241bfa8d2e34ea579f8a6)
I20260619 13:50:46.000525 1646 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 2 FOLLOWER]: Advancing to term 3
I20260619 13:50:46.015601 1646 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:46.016405 1646 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 3 election: Requested vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
I20260619 13:50:46.017318 1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7adca601777549878be161a6116e53b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 33 } } ignore_live_leader: false dest_uuid: "fe5c828398bf4cd592f4a0b084a304b7"
I20260619 13:50:46.017591 1559 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 1 FOLLOWER]: Advancing to term 3
W20260619 13:50:46.018474 721 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:50:46.032110 1473 consensus_queue.cc:1048] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 13:50:46.121855 1559 raft_consensus.cc:2468] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7adca601777549878be161a6116e53b6 in term 3.
I20260619 13:50:46.122910 723 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7adca601777549878be161a6116e53b6, fe5c828398bf4cd592f4a0b084a304b7; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6
I20260619 13:50:46.123430 1646 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260619 13:50:46.125123 1646 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 3 LEADER]: Becoming Leader. State: Replica: 7adca601777549878be161a6116e53b6, State: Running, Role: LEADER
I20260619 13:50:46.125681 1646 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 33, Committed index: 33, Last appended: 2.33, Last appended by leader: 33, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:46.127409 1653 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7adca601777549878be161a6116e53b6. Latest consensus state: current_term: 3 leader_uuid: "7adca601777549878be161a6116e53b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:46.127748 1653 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: This master's current role is: LEADER
I20260619 13:50:46.128311 1654 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260619 13:50:46.131361 1654 catalog_manager.cc:679] Loaded metadata for table default.table_1623c8da7f1e42958362607cf3bed6f0 [id=2d3dc93800df4ce7bcaa51ca2d5172eb]
I20260619 13:50:46.132020 1654 catalog_manager.cc:679] Loaded metadata for table default.table_06260aeaf35a4709a2f2596a0268c737 [id=2f052b286bee49df9c7ae8cd8ecfd90b]
I20260619 13:50:46.132478 1654 catalog_manager.cc:679] Loaded metadata for table default.table_2138876d1fe74e81bfc560e2fb592a0e [id=57c8bf0937b84407ace807934df053c4]
I20260619 13:50:46.132990 1654 catalog_manager.cc:679] Loaded metadata for table default.table_08f0dacfa3d348c9ab0e8387f52e681a [id=7774d59813b44a19864817d47194e724]
I20260619 13:50:46.133430 1654 catalog_manager.cc:679] Loaded metadata for table default.table_71421a29531045198619e2e3d9383268 [id=8385a644150b489d9d4f61e2338d081e]
I20260619 13:50:46.133970 1654 catalog_manager.cc:679] Loaded metadata for table default.table_c1ef2fe395ec45c98ee34472a137d486 [id=9aea7bf089c54100afe5510f3b4ec4ae]
I20260619 13:50:46.134351 1654 catalog_manager.cc:679] Loaded metadata for table default.table_75fff73b19164084879700104d9a214c [id=c250a119cf6642b2ad489636485fceac]
I20260619 13:50:46.134828 1654 catalog_manager.cc:679] Loaded metadata for table default.table_6a76b7745ccc406facfc1fc1021b24d9 [id=d0fb54a9a55b4a3b83f7c809ef7d24ea]
I20260619 13:50:46.135316 1654 catalog_manager.cc:679] Loaded metadata for table default.table_8ba4a12b36bd4159a70fe23f31c1e862 [id=e009fdd5a6e2488f9f7bfa3ed6005316]
I20260619 13:50:46.138128 1654 tablet_loader.cc:96] loaded metadata for tablet 3491c8ba98ae45c1a6ba15a03d9d55f2 (table default.table_2138876d1fe74e81bfc560e2fb592a0e [id=57c8bf0937b84407ace807934df053c4])
I20260619 13:50:46.138487 1654 tablet_loader.cc:96] loaded metadata for tablet 81c901680eb84fe7ae5957ca045f2d69 (table default.table_c1ef2fe395ec45c98ee34472a137d486 [id=9aea7bf089c54100afe5510f3b4ec4ae])
I20260619 13:50:46.138844 1654 tablet_loader.cc:96] loaded metadata for tablet afd1f4707bec4f61b6001eb88426f985 (table default.table_06260aeaf35a4709a2f2596a0268c737 [id=2f052b286bee49df9c7ae8cd8ecfd90b])
I20260619 13:50:46.139168 1654 tablet_loader.cc:96] loaded metadata for tablet bf536238326544e7ba59cc441da29696 (table default.table_08f0dacfa3d348c9ab0e8387f52e681a [id=7774d59813b44a19864817d47194e724])
I20260619 13:50:46.139508 1654 tablet_loader.cc:96] loaded metadata for tablet c72a70b85f464558a625e293380f610b (table default.table_8ba4a12b36bd4159a70fe23f31c1e862 [id=e009fdd5a6e2488f9f7bfa3ed6005316])
I20260619 13:50:46.139820 1654 tablet_loader.cc:96] loaded metadata for tablet c8d8f0fa96f04d2b9dd9e4a3e7c97041 (table default.table_6a76b7745ccc406facfc1fc1021b24d9 [id=d0fb54a9a55b4a3b83f7c809ef7d24ea])
I20260619 13:50:46.140165 1654 tablet_loader.cc:96] loaded metadata for tablet d66b1eaa29454bb3bc8e2c493d01cb43 (table default.table_1623c8da7f1e42958362607cf3bed6f0 [id=2d3dc93800df4ce7bcaa51ca2d5172eb])
I20260619 13:50:46.140487 1654 tablet_loader.cc:96] loaded metadata for tablet d7f76b3a50b24ef380870ccd67510d57 (table default.table_71421a29531045198619e2e3d9383268 [id=8385a644150b489d9d4f61e2338d081e])
I20260619 13:50:46.140769 1654 tablet_loader.cc:96] loaded metadata for tablet e637f2b405c445a1afee9cd9c9db8d08 (table default.table_75fff73b19164084879700104d9a214c [id=c250a119cf6642b2ad489636485fceac])
I20260619 13:50:46.141259 1654 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260619 13:50:46.142427 1654 catalog_manager.cc:1294] Loaded cluster ID: 83fe01e7c5804ae9b7b2307f12c08ec9
I20260619 13:50:46.142503 1654 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260619 13:50:46.143851 1654 catalog_manager.cc:1539] Loading token signing keys...
I20260619 13:50:46.144817 1654 catalog_manager.cc:6080] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6: Loaded TSK: 0
I20260619 13:50:46.145865 1654 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260619 13:50:46.146947 1654 catalog_manager.cc:1562] Loading latest processed Hive Metastore notification log event ID...
I20260619 13:50:46.148106 1654 catalog_manager.cc:5918] Last processed Hive Metastore notification event ID: -1
I20260619 13:50:46.153097 737 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44134:
name: "default.Table_6b5ec95d9cfd4a979c14eac5784df343"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:46.154861 735 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44134:
table { table_name: "default.Table_71421a29531045198619e2e3d9383268" } modify_external_catalogs: true
I20260619 13:50:46.154981 732 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44134:
name: "default.Table_59c8023d6dec4ca985120f5dbf942dc8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:46.155257 735 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44134:
table { table_name: "default.Table_71421a29531045198619e2e3d9383268" } modify_external_catalogs: true
I20260619 13:50:46.155522 731 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44134:
table { table_name: "default.Table_8ba4a12b36bd4159a70fe23f31c1e862" } modify_external_catalogs: true
I20260619 13:50:46.155768 731 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44134:
table { table_name: "default.Table_8ba4a12b36bd4159a70fe23f31c1e862" } modify_external_catalogs: true
I20260619 13:50:46.155849 736 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44134:
name: "default.Table_0a1998b5c2b34b7ab34528ad19b3cf84"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:46.156026 734 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44134:
name: "default.Table_04077192a2444da49f04c39c741733bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:46.156222 728 master_service.cc:960] ReplaceTablet: received request to replace tablet c8d8f0fa96f04d2b9dd9e4a3e7c97041 from {username='slave'} at 127.0.0.1:44134
I20260619 13:50:46.154915 733 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44134:
table { table_name: "default.Table_08f0dacfa3d348c9ab0e8387f52e681a" } modify_external_catalogs: true
I20260619 13:50:46.156599 733 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44134:
table { table_name: "default.Table_08f0dacfa3d348c9ab0e8387f52e681a" } modify_external_catalogs: true
I20260619 13:50:46.156558 729 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44134:
name: "default.Table_a99ce2d337bd4e478e3c1723e2a85c8a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:46.157028 730 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44134:
table { table_name: "default.Table_06260aeaf35a4709a2f2596a0268c737" } modify_external_catalogs: true
I20260619 13:50:46.157295 730 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44134:
table { table_name: "default.Table_06260aeaf35a4709a2f2596a0268c737" } modify_external_catalogs: true
I20260619 13:50:46.162781 1559 raft_consensus.cc:1275] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Refusing update from remote peer 7adca601777549878be161a6116e53b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 35. (index mismatch)
W20260619 13:50:46.163028 721 consensus_peers.cc:597] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 -> Peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Couldn't send request to peer 6184e94a3ec241bfa8d2e34ea579f8a6. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
F20260619 13:50:46.164286 951 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 1, previous 1; dumping first 2 out of 10 received events: NotificationEvent(eventId=1, eventTime=1781877043, eventType=CREATE_TABLE, dbName=default, tableName=table_2138876d1fe74e81bfc560e2fb592a0e, message={"server":"","servicePrincipal":"","db":"default","table":"table_2138876d1fe74e81bfc560e2fb592a0e","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_2138876d1fe74e81bfc560e2fb592a0e\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1781877043},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/warehouse/table_2138876d1fe74e81bfc560e2fb592a0e\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_2138876d1fe74e81bfc560e2fb592a0e\",\"kudu.table_id\":\"57c8bf0937b84407ace807934df053c4\",\"transient_lastDdlTime\":\"1781877043\",\"comment\":\"\",\"kudu.master_addresses\":\"127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"83fe01e7c5804ae9b7b2307f12c08ec9\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1781877043,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=1, eventTime=1781877043, eventType=CREATE_TABLE, dbName=default, tableName=table_c52ddc84a5e24c718eba7aab2234f558, message={"server":"","servicePrincipal":"","db":"default","table":"table_c52ddc84a5e24c718eba7aab2234f558","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_c52ddc84a5e24c718eba7aab2234f558\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1781877043},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/warehouse/table_c52ddc84a5e24c718eba7aab2234f558\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_c52ddc84a5e24c718eba7aab2234f558\",\"kudu.table_id\":\"b3b37daaec8c448a98386eb208b2cd04\",\"transient_lastDdlTime\":\"1781877043\",\"comment\":\"\",\"kudu.master_addresses\":\"127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"83fe01e7c5804ae9b7b2307f12c08ec9\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1781877043,"files":[]}, messageFormat=json-0.2, catName=hive);
I20260619 13:50:46.164640 1646 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 4, Time since last communication: 0.000s
*** Check failure stack trace: ***
@ 0x7fe5eede1dcd google::LogMessage::Fail() at ??:0
@ 0x7fe5eede5b93 google::LogMessage::SendToLog() at ??:0
@ 0x7fe5eede17cc google::LogMessage::Flush() at ??:0
@ 0x7fe5eede1a11 google::LogMessage::~LogMessage() at ??:0
@ 0x7fe6059dc394 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260619 13:50:46.179379 1644 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7adca601777549878be161a6116e53b6. Latest consensus state: current_term: 3 leader_uuid: "7adca601777549878be161a6116e53b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:46.179659 1644 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 13:50:46.180007 1659 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "7adca601777549878be161a6116e53b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:46.180344 1659 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7fe6059dac41 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260619 13:50:46.183990 1659 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "7adca601777549878be161a6116e53b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:46.184228 1659 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7fe6059e28bc kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260619 13:50:46.188755 1646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "7adca601777549878be161a6116e53b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:46.189059 1646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: This master's current role is: LEADER
I20260619 13:50:46.190464 728 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6: Sending DeleteTablet for 3 replicas of tablet c8d8f0fa96f04d2b9dd9e4a3e7c97041
I20260619 13:50:46.192639 728 catalog_manager.cc:6784] ReplaceTablet: tablet c8d8f0fa96f04d2b9dd9e4a3e7c97041 deleted and replaced by tablet b1cf3f5226e7408d8eadb8d0fb670d7b
@ 0x7fe6059e2739 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa681d std::function<>::operator()() at ??:?
I20260619 13:50:46.202219 728 master_service.cc:960] ReplaceTablet: received request to replace tablet 81c901680eb84fe7ae5957ca045f2d69 from {username='slave'} at 127.0.0.1:44134
I20260619 13:50:46.207612 1046 tablet_service.cc:1558] Processing DeleteTablet for tablet c8d8f0fa96f04d2b9dd9e4a3e7c97041 with delete_type TABLET_DATA_DELETED (replaced by tablet b1cf3f5226e7408d8eadb8d0fb670d7b) from {username='slave'} at 127.0.0.1:47430
I20260619 13:50:46.213004 1047 tablet_service.cc:1511] Processing CreateTablet for tablet b1cf3f5226e7408d8eadb8d0fb670d7b (DEFAULT_TABLE table=default.table_6a76b7745ccc406facfc1fc1021b24d9 [id=d0fb54a9a55b4a3b83f7c809ef7d24ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:46.213609 1047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1cf3f5226e7408d8eadb8d0fb670d7b. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7fe5f1b08f49 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fe5f51d26db start_thread at ??:0
I20260619 13:50:46.218189 728 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6: Sending DeleteTablet for 3 replicas of tablet 81c901680eb84fe7ae5957ca045f2d69
@ 0x7fe5edc9061f clone at ??:0
I20260619 13:50:46.222002 1671 tablet_replica.cc:333] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f: stopping tablet replica
I20260619 13:50:46.222265 1671 raft_consensus.cc:2243] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f [term 1 LEADER]: Raft consensus shutting down.
I20260619 13:50:46.222862 1671 raft_consensus.cc:2272] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 13:50:46.224010 1671 ts_tablet_manager.cc:1916] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 13:50:46.234356 1673 tablet_bootstrap.cc:492] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f: Bootstrap starting.
I20260619 13:50:46.236542 1673 tablet_bootstrap.cc:654] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:46.240541 1657 mvcc.cc:204] Tried to move back new op lower bound from 7298568381070163968 to 7298568371145728000. Current Snapshot: MvccSnapshot[applied={T|T < 7298568381070163968 or (T in {7298568381070163968})}]
I20260619 13:50:46.247382 1673 tablet_bootstrap.cc:492] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f: No bootstrap required, opened a new log
I20260619 13:50:46.247581 1673 ts_tablet_manager.cc:1403] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.012s
I20260619 13:50:46.248543 1673 raft_consensus.cc:359] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:46.248733 1673 raft_consensus.cc:385] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:46.248826 1673 raft_consensus.cc:740] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 380c26fd105f454cbe8ef6b87e35f41f, State: Initialized, Role: FOLLOWER
I20260619 13:50:46.249078 1673 consensus_queue.cc:260] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:46.257157 1673 ts_tablet_manager.cc:1434] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f: Time spent starting tablet: real 0.009s user 0.004s sys 0.006s
I20260619 13:50:46.330575 1671 ts_tablet_manager.cc:1929] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 13:50:46.330809 1671 log.cc:1199] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f: Deleting WAL directory at /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-0/wal/wals/c8d8f0fa96f04d2b9dd9e4a3e7c97041
I20260619 13:50:46.331288 1671 ts_tablet_manager.cc:1950] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 380c26fd105f454cbe8ef6b87e35f41f: Deleting consensus metadata
I20260619 13:50:46.382375 1676 consensus_queue.cc:1048] T afd1f4707bec4f61b6001eb88426f985 P 380c26fd105f454cbe8ef6b87e35f41f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 13:50:46.390409 1683 consensus_queue.cc:1048] T afd1f4707bec4f61b6001eb88426f985 P 380c26fd105f454cbe8ef6b87e35f41f [LEADER]: Connected to new peer: Peer: permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 13:50:46.440546 1004 connection.cc:573] server connection from 127.0.0.1:47430 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 13:50:46.441846 1668 negotiation.cc:336] Failed RPC negotiation. Trace:
0619 13:50:46.198136 (+ 0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:34288 (local address 127.0.105.66:33481)
0619 13:50:46.199273 (+ 1137us) server_negotiation.cc:207] Beginning negotiation
0619 13:50:46.199281 (+ 8us) server_negotiation.cc:400] Waiting for connection header
0619 13:50:46.199299 (+ 18us) server_negotiation.cc:408] Connection header received
0619 13:50:46.199379 (+ 80us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0619 13:50:46.199387 (+ 8us) server_negotiation.cc:462] Received NEGOTIATE request from client
0619 13:50:46.199490 (+ 103us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0619 13:50:46.201862 (+ 2372us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0619 13:50:46.202101 (+ 239us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0619 13:50:46.203481 (+ 1380us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
0619 13:50:46.440809 (+237328us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34288: BlockingRecv error: recv got EOF from 127.0.0.1:34288 (error 108)
Metrics: {"server-negotiator.queue_time_us":1006,"thread_start_us":908,"threads_started":1}
W20260619 13:50:46.441841 1669 negotiation.cc:336] Failed RPC negotiation. Trace:
0619 13:50:46.198474 (+ 0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:45036 (local address 127.0.105.67:33847)
0619 13:50:46.199915 (+ 1441us) server_negotiation.cc:207] Beginning negotiation
0619 13:50:46.199921 (+ 6us) server_negotiation.cc:400] Waiting for connection header
0619 13:50:46.201556 (+ 1635us) server_negotiation.cc:408] Connection header received
0619 13:50:46.201642 (+ 86us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0619 13:50:46.201648 (+ 6us) server_negotiation.cc:462] Received NEGOTIATE request from client
0619 13:50:46.201719 (+ 71us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0619 13:50:46.204739 (+ 3020us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0619 13:50:46.204948 (+ 209us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0619 13:50:46.216749 (+ 11801us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
0619 13:50:46.440759 (+224010us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45036: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":1321,"thread_start_us":1188,"threads_started":1}
W20260619 13:50:46.442211 1003 connection.cc:573] client connection to 127.0.105.126:34929 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 13:50:46.442255 1278 connection.cc:573] client connection to 127.0.105.126:34929 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 13:50:46.442570 1397 connection.cc:573] client connection to 127.0.105.126:34929 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 13:50:46.442648 1140 connection.cc:573] client connection to 127.0.105.126:34929 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260619 13:50:46.531998 1689 consensus_queue.cc:1048] T bf536238326544e7ba59cc441da29696 P 94599283b9334819b3bbe25509b7cd16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 13:50:46.539134 1627 catalog_manager.cc:1294] Loaded cluster ID: 83fe01e7c5804ae9b7b2307f12c08ec9
I20260619 13:50:46.539278 1627 catalog_manager.cc:1587] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: loading cluster ID for follower catalog manager: success
I20260619 13:50:46.541152 1688 consensus_queue.cc:1048] T bf536238326544e7ba59cc441da29696 P 94599283b9334819b3bbe25509b7cd16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 13:50:46.545364 1627 catalog_manager.cc:1609] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: acquiring CA information for follower catalog manager: success
I20260619 13:50:46.548485 1627 catalog_manager.cc:1637] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 13:50:46.550416 1467 consensus_queue.cc:1048] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 13:50:46.556682 1652 consensus_queue.cc:1048] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 13:50:46.716409 1698 raft_consensus.cc:493] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7adca601777549878be161a6116e53b6)
I20260619 13:50:46.716643 1698 raft_consensus.cc:515] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:46.717537 1698 leader_election.cc:290] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:50:46.721108 1531 leader_election.cc:336] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
W20260619 13:50:46.721354 1529 leader_election.cc:336] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:50:46.721535 1529 leader_election.cc:304] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe5c828398bf4cd592f4a0b084a304b7; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, 7adca601777549878be161a6116e53b6
I20260619 13:50:46.721807 1698 raft_consensus.cc:2749] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260619 13:50:46.746688 1688 consensus_queue.cc:1048] T d7f76b3a50b24ef380870ccd67510d57 P 94599283b9334819b3bbe25509b7cd16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 13:50:46.757825 1639 consensus_queue.cc:1048] T d7f76b3a50b24ef380870ccd67510d57 P 94599283b9334819b3bbe25509b7cd16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 13:50:46.963653 1691 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:50:46.963912 1691 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:46.964602 1691 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:50:46.965847 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:50:46.966094 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:50:46.966239 1004 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:50:46.966544 1691 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 13:50:47.377254 1714 raft_consensus.cc:493] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7adca601777549878be161a6116e53b6)
I20260619 13:50:47.377560 1714 raft_consensus.cc:515] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:47.378278 1714 leader_election.cc:290] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:50:47.380388 1531 leader_election.cc:336] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
W20260619 13:50:47.380586 1529 leader_election.cc:336] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:50:47.380748 1529 leader_election.cc:304] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe5c828398bf4cd592f4a0b084a304b7; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, 7adca601777549878be161a6116e53b6
I20260619 13:50:47.381033 1714 raft_consensus.cc:2749] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260619 13:50:48.159989 1725 raft_consensus.cc:493] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7adca601777549878be161a6116e53b6)
I20260619 13:50:48.160233 1725 raft_consensus.cc:515] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:48.160928 1725 leader_election.cc:290] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:50:48.163429 1529 leader_election.cc:336] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:50:48.163617 1531 leader_election.cc:336] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
I20260619 13:50:48.163744 1531 leader_election.cc:304] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe5c828398bf4cd592f4a0b084a304b7; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, 7adca601777549878be161a6116e53b6
I20260619 13:50:48.164018 1725 raft_consensus.cc:2749] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260619 13:50:48.448128 1652 raft_consensus.cc:493] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 380c26fd105f454cbe8ef6b87e35f41f)
I20260619 13:50:48.448446 1652 raft_consensus.cc:515] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:48.449167 1652 leader_election.cc:290] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865), 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481)
I20260619 13:50:48.449827 1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d8f0fa96f04d2b9dd9e4a3e7c97041" candidate_uuid: "d54f30d62f034b35a8e73ff525ba43d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "94599283b9334819b3bbe25509b7cd16" is_pre_election: true
I20260619 13:50:48.450057 1205 raft_consensus.cc:2468] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 94599283b9334819b3bbe25509b7cd16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d54f30d62f034b35a8e73ff525ba43d9 in term 1.
W20260619 13:50:48.450318 1278 leader_election.cc:343] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041
I20260619 13:50:48.450559 1277 leader_election.cc:304] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9; no voters: 380c26fd105f454cbe8ef6b87e35f41f
I20260619 13:50:48.450870 1652 raft_consensus.cc:2804] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260619 13:50:48.450946 1652 raft_consensus.cc:493] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 380c26fd105f454cbe8ef6b87e35f41f)
I20260619 13:50:48.451074 1652 raft_consensus.cc:3060] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 [term 1 FOLLOWER]: Advancing to term 2
I20260619 13:50:48.452924 1652 raft_consensus.cc:515] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:48.453603 1652 leader_election.cc:290] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 [CANDIDATE]: Term 2 election: Requested vote from peers 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865), 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481)
I20260619 13:50:48.454102 1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d8f0fa96f04d2b9dd9e4a3e7c97041" candidate_uuid: "d54f30d62f034b35a8e73ff525ba43d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "94599283b9334819b3bbe25509b7cd16"
I20260619 13:50:48.454334 1205 raft_consensus.cc:3060] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 94599283b9334819b3bbe25509b7cd16 [term 1 FOLLOWER]: Advancing to term 2
W20260619 13:50:48.454384 1278 leader_election.cc:343] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041
I20260619 13:50:48.456218 1205 raft_consensus.cc:2468] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 94599283b9334819b3bbe25509b7cd16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d54f30d62f034b35a8e73ff525ba43d9 in term 2.
I20260619 13:50:48.456640 1277 leader_election.cc:304] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9; no voters: 380c26fd105f454cbe8ef6b87e35f41f
I20260619 13:50:48.456921 1652 raft_consensus.cc:2804] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 13:50:48.457104 1652 raft_consensus.cc:697] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 [term 2 LEADER]: Becoming Leader. State: Replica: d54f30d62f034b35a8e73ff525ba43d9, State: Running, Role: LEADER
I20260619 13:50:48.457950 1652 consensus_queue.cc:237] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:48.539228 421 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
/tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.124:40279
--webserver_interface=127.0.105.124
--webserver_port=45257
--builtin_ntp_servers=127.0.105.84:41509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--hive_metastore_uris=thrift://127.0.0.1:39807
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260619 13:50:48.770725 1737 raft_consensus.cc:493] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7adca601777549878be161a6116e53b6)
I20260619 13:50:48.770901 1737 raft_consensus.cc:515] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:48.771688 1737 leader_election.cc:290] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:50:48.774248 1531 leader_election.cc:336] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
W20260619 13:50:48.774457 1529 leader_election.cc:336] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:50:48.774598 1529 leader_election.cc:304] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe5c828398bf4cd592f4a0b084a304b7; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, 7adca601777549878be161a6116e53b6
I20260619 13:50:48.774847 1737 raft_consensus.cc:2749] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260619 13:50:48.899818 1732 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 13:50:48.900241 1732 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 13:50:48.900377 1732 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260619 13:50:48.909440 1732 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 13:50:48.909626 1732 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260619 13:50:48.909731 1732 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 13:50:48.909821 1732 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260619 13:50:48.920531 1732 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.84:41509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:39807
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.124:40279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.105.124
--webserver_port=45257
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 19 Jun 2026 13:43:23 UTC on bdcb31816ec0
build id 12470
ASAN enabled
I20260619 13:50:48.922330 1732 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 13:50:48.924383 1732 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260619 13:50:48.933175 1748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:50:48.933144 1749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:50:48.933880 1751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 13:50:48.934724 1732 server_base.cc:1061] running on GCE node
I20260619 13:50:48.935678 1732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 13:50:48.937316 1732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 13:50:48.938589 1732 hybrid_clock.cc:648] HybridClock initialized: now 1781877048938514 us; error 65 us; skew 500 ppm
I20260619 13:50:48.938993 1732 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 13:50:48.941365 1732 webserver.cc:533] Webserver started at http://127.0.105.124:45257/ using document root <none> and password file <none>
I20260619 13:50:48.942227 1732 fs_manager.cc:362] Metadata directory not provided
I20260619 13:50:48.942389 1732 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 13:50:48.948578 1732 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260619 13:50:48.951644 1757 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 13:50:48.953217 1732 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 13:50:48.953440 1732 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data,/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/wal
uuid: "6184e94a3ec241bfa8d2e34ea579f8a6"
format_stamp: "Formatted at 2026-06-19 13:50:41 on dist-test-slave-7hnr"
I20260619 13:50:48.954403 1732 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 13:50:48.980546 1732 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260619 13:50:48.981613 1732 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 13:50:48.981930 1732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 13:50:49.003109 1732 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.124:40279
I20260619 13:50:49.003126 1808 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.124:40279 every 8 connection(s)
I20260619 13:50:49.005102 1732 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data/info.pb
I20260619 13:50:49.009925 421 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu as pid 1732
I20260619 13:50:49.012956 1809 sys_catalog.cc:263] Verifying existing consensus state
I20260619 13:50:49.016965 1809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: Bootstrap starting.
I20260619 13:50:49.032208 1809 log.cc:826] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: Log is configured to *not* fsync() on all Append() calls
I20260619 13:50:49.060768 1809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=33 overwritten=0 applied=33 ignored=0} inserts{seen=24 ignored=0} mutations{seen=20 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 13:50:49.061401 1809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: Bootstrap complete.
I20260619 13:50:49.066980 1809 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:49.067724 1809 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6184e94a3ec241bfa8d2e34ea579f8a6, State: Initialized, Role: FOLLOWER
I20260619 13:50:49.068382 1809 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 33, Last appended: 2.33, Last appended by leader: 33, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:49.069229 1814 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:49.069561 1814 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 13:50:49.070379 1809 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 13:50:49.081162 1732 master_runner.cc:187] Error getting master registration for 127.0.105.126:34929: Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111),
I20260619 13:50:49.087260 1828 catalog_manager.cc:1294] Loaded cluster ID: 83fe01e7c5804ae9b7b2307f12c08ec9
I20260619 13:50:49.087404 1828 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: loading cluster ID for follower catalog manager: success
I20260619 13:50:49.087409 1732 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:50:49.091507 1828 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: acquiring CA information for follower catalog manager: success
I20260619 13:50:49.094696 1828 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 13:50:49.112710 1250 heartbeater.cc:344] Connected to a master server at 127.0.105.124:40279
I20260619 13:50:49.116912 1774 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "94599283b9334819b3bbe25509b7cd16" instance_seqno: 1781877042768620) as {username='slave'} at 127.0.105.66:56355; Asking this server to re-register.
I20260619 13:50:49.117935 1250 heartbeater.cc:461] Registering TS with master...
I20260619 13:50:49.120149 1774 ts_manager.cc:194] Registered new tserver with Master: 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481)
I20260619 13:50:49.265617 1113 heartbeater.cc:344] Connected to a master server at 127.0.105.124:40279
I20260619 13:50:49.267527 1774 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" instance_seqno: 1781877042220212) as {username='slave'} at 127.0.105.65:52589; Asking this server to re-register.
I20260619 13:50:49.268215 1113 heartbeater.cc:461] Registering TS with master...
I20260619 13:50:49.269639 1774 ts_manager.cc:194] Registered new tserver with Master: 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865)
I20260619 13:50:49.288565 1388 heartbeater.cc:344] Connected to a master server at 127.0.105.124:40279
I20260619 13:50:49.290828 1774 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" instance_seqno: 1781877043287674) as {username='slave'} at 127.0.105.67:57343; Asking this server to re-register.
I20260619 13:50:49.291525 1388 heartbeater.cc:461] Registering TS with master...
I20260619 13:50:49.293080 1774 ts_manager.cc:194] Registered new tserver with Master: d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
I20260619 13:50:49.310918 1205 raft_consensus.cc:1275] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P 94599283b9334819b3bbe25509b7cd16 [term 2 FOLLOWER]: Refusing update from remote peer d54f30d62f034b35a8e73ff525ba43d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260619 13:50:49.311641 1719 consensus_queue.cc:1048] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260619 13:50:49.327859 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 1: this message will repeat every 5th retry.
I20260619 13:50:49.649027 1841 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:50:49.649358 1841 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:49.651316 1841 leader_election.cc:290] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003)
W20260619 13:50:49.652509 1760 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
W20260619 13:50:49.654150 1760 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
I20260619 13:50:49.658661 1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 33 } } ignore_live_leader: false dest_uuid: "fe5c828398bf4cd592f4a0b084a304b7" is_pre_election: true
I20260619 13:50:49.659080 1559 raft_consensus.cc:2393] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6184e94a3ec241bfa8d2e34ea579f8a6 in current term 3: Already voted for candidate 7adca601777549878be161a6116e53b6 in this term.
I20260619 13:50:49.660017 1760 leader_election.cc:304] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6184e94a3ec241bfa8d2e34ea579f8a6; no voters: 7adca601777549878be161a6116e53b6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:50:49.660450 1841 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 2 FOLLOWER]: Advancing to term 3
I20260619 13:50:49.664637 1841 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260619 13:50:50.140944 1847 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:50:50.141207 1847 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:50.141966 1847 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:50:50.143062 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:50:50.143255 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:50:50.143455 1002 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:50:50.143769 1847 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 13:50:50.198001 1849 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:50:50.198256 1849 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:50.198979 1849 leader_election.cc:290] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003)
I20260619 13:50:50.200251 1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 33 } } ignore_live_leader: false dest_uuid: "fe5c828398bf4cd592f4a0b084a304b7" is_pre_election: true
I20260619 13:50:50.200577 1559 raft_consensus.cc:2410] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6184e94a3ec241bfa8d2e34ea579f8a6 for term 4 because replica has last-logged OpId of term: 3 index: 37, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 33.
W20260619 13:50:50.201126 1760 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
I20260619 13:50:50.201329 1760 leader_election.cc:304] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6184e94a3ec241bfa8d2e34ea579f8a6; no voters: 7adca601777549878be161a6116e53b6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:50:50.201678 1849 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260619 13:50:50.767112 1859 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:50:50.767328 1859 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:50.768018 1859 leader_election.cc:290] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003)
I20260619 13:50:50.769148 1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 33 } } ignore_live_leader: false dest_uuid: "fe5c828398bf4cd592f4a0b084a304b7" is_pre_election: true
I20260619 13:50:50.769526 1559 raft_consensus.cc:2410] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6184e94a3ec241bfa8d2e34ea579f8a6 for term 4 because replica has last-logged OpId of term: 3 index: 37, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 33.
W20260619 13:50:50.770135 1760 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
I20260619 13:50:50.770300 1760 leader_election.cc:304] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6184e94a3ec241bfa8d2e34ea579f8a6; no voters: 7adca601777549878be161a6116e53b6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:50:50.770593 1859 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260619 13:50:50.787818 1474 master_runner.cc:187] Error getting master registration for 127.0.105.126:34929: Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111),
I20260619 13:50:50.788048 1474 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:50:51.140295 421 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu pid 1732
I20260619 13:50:51.147827 1804 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 13:50:51.217248 1870 raft_consensus.cc:493] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7adca601777549878be161a6116e53b6)
I20260619 13:50:51.217482 1870 raft_consensus.cc:515] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:51.218267 1870 leader_election.cc:290] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:50:51.218994 1531 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111) [suppressed 8 similar messages]
W20260619 13:50:51.220389 1531 leader_election.cc:336] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
I20260619 13:50:51.259344 421 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu with pid 1732
W20260619 13:50:51.279654 1001 connection.cc:573] client connection to 127.0.105.124:40279 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 13:50:51.279795 1862 negotiation.cc:336] Failed RPC negotiation. Trace:
0619 13:50:51.218518 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.0.105.124:40279 (local address 127.0.0.1:51400)
0619 13:50:51.219008 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0619 13:50:51.219022 (+ 14us) client_negotiation.cc:175] Beginning negotiation
0619 13:50:51.219221 (+ 199us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0619 13:50:51.259032 (+ 39811us) client_negotiation.cc:272] Received NEGOTIATE NegotiatePB response
0619 13:50:51.259037 (+ 5us) client_negotiation.cc:395] Received NEGOTIATE response from server
0619 13:50:51.259073 (+ 36us) client_negotiation.cc:190] Negotiated authn=CERTIFICATE
0619 13:50:51.259768 (+ 695us) client_negotiation.cc:515] Sending TLS_HANDSHAKE message to server
0619 13:50:51.259787 (+ 19us) client_negotiation.cc:253] Sending TLS_HANDSHAKE NegotiatePB request
0619 13:50:51.279485 (+ 19698us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":251,"threads_started":1}
W20260619 13:50:51.281255 1529 leader_election.cc:336] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:50:51.281447 1529 leader_election.cc:304] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe5c828398bf4cd592f4a0b084a304b7; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, 7adca601777549878be161a6116e53b6
I20260619 13:50:51.281731 1870 raft_consensus.cc:2749] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260619 13:50:52.082430 421 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
/tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.124:40279
--webserver_interface=127.0.105.124
--webserver_port=45257
--builtin_ntp_servers=127.0.105.84:41509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--hive_metastore_uris=thrift://127.0.0.1:39807
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260619 13:50:52.440824 1883 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 13:50:52.441177 1883 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 13:50:52.441360 1883 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260619 13:50:52.450762 1883 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 13:50:52.450874 1883 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260619 13:50:52.450973 1883 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 13:50:52.451050 1883 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260619 13:50:52.455477 1890 raft_consensus.cc:493] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7adca601777549878be161a6116e53b6)
I20260619 13:50:52.455674 1890 raft_consensus.cc:515] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:52.456511 1890 leader_election.cc:290] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:50:52.459081 1529 leader_election.cc:336] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:50:52.459322 1531 leader_election.cc:336] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
I20260619 13:50:52.459482 1531 leader_election.cc:304] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe5c828398bf4cd592f4a0b084a304b7; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, 7adca601777549878be161a6116e53b6
I20260619 13:50:52.459812 1890 raft_consensus.cc:2749] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260619 13:50:52.463495 1883 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.84:41509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:39807
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.124:40279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.105.124
--webserver_port=45257
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 19 Jun 2026 13:43:23 UTC on bdcb31816ec0
build id 12470
ASAN enabled
I20260619 13:50:52.465170 1883 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 13:50:52.467597 1883 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260619 13:50:52.477417 1895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:50:52.478169 1896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:50:52.478919 1898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 13:50:52.479250 1883 server_base.cc:1061] running on GCE node
I20260619 13:50:52.480113 1883 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 13:50:52.481696 1883 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 13:50:52.482926 1883 hybrid_clock.cc:648] HybridClock initialized: now 1781877052482866 us; error 58 us; skew 500 ppm
I20260619 13:50:52.483290 1883 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 13:50:52.485641 1883 webserver.cc:533] Webserver started at http://127.0.105.124:45257/ using document root <none> and password file <none>
I20260619 13:50:52.486419 1883 fs_manager.cc:362] Metadata directory not provided
I20260619 13:50:52.486563 1883 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 13:50:52.492506 1883 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260619 13:50:52.495702 1904 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 13:50:52.497159 1883 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 13:50:52.497354 1883 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data,/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/wal
uuid: "6184e94a3ec241bfa8d2e34ea579f8a6"
format_stamp: "Formatted at 2026-06-19 13:50:41 on dist-test-slave-7hnr"
I20260619 13:50:52.498167 1883 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 13:50:52.525691 1883 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260619 13:50:52.526861 1883 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 13:50:52.527256 1883 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 13:50:52.547947 1883 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.124:40279
I20260619 13:50:52.547969 1955 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.124:40279 every 8 connection(s)
I20260619 13:50:52.549753 1883 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data/info.pb
I20260619 13:50:52.557119 1956 sys_catalog.cc:263] Verifying existing consensus state
I20260619 13:50:52.558669 421 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu as pid 1883
I20260619 13:50:52.561193 1956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: Bootstrap starting.
I20260619 13:50:52.576817 1956 log.cc:826] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: Log is configured to *not* fsync() on all Append() calls
I20260619 13:50:52.604431 1956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=33 overwritten=0 applied=33 ignored=0} inserts{seen=24 ignored=0} mutations{seen=20 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 13:50:52.605047 1956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: Bootstrap complete.
I20260619 13:50:52.610563 1956 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:52.611274 1956 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6184e94a3ec241bfa8d2e34ea579f8a6, State: Initialized, Role: FOLLOWER
I20260619 13:50:52.611943 1956 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 33, Last appended: 2.33, Last appended by leader: 33, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:52.612691 1961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:52.612982 1961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 13:50:52.613827 1956 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 13:50:52.625651 1975 catalog_manager.cc:1294] Loaded cluster ID: 83fe01e7c5804ae9b7b2307f12c08ec9
I20260619 13:50:52.625876 1975 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: loading cluster ID for follower catalog manager: success
I20260619 13:50:52.630896 1975 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: acquiring CA information for follower catalog manager: success
I20260619 13:50:52.634056 1975 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 13:50:52.635520 1883 master_runner.cc:187] Error getting master registration for 127.0.105.126:34929: Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111),
I20260619 13:50:52.641479 1883 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:50:52.791396 1113 heartbeater.cc:344] Connected to a master server at 127.0.105.124:40279
I20260619 13:50:52.794322 1921 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" instance_seqno: 1781877042220212) as {username='slave'} at 127.0.105.65:36897; Asking this server to re-register.
I20260619 13:50:52.795223 1113 heartbeater.cc:461] Registering TS with master...
I20260619 13:50:52.797055 1921 ts_manager.cc:194] Registered new tserver with Master: 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865)
I20260619 13:50:52.850998 1250 heartbeater.cc:344] Connected to a master server at 127.0.105.124:40279
I20260619 13:50:52.852499 1921 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "94599283b9334819b3bbe25509b7cd16" instance_seqno: 1781877042768620) as {username='slave'} at 127.0.105.66:57297; Asking this server to re-register.
I20260619 13:50:52.853107 1250 heartbeater.cc:461] Registering TS with master...
I20260619 13:50:52.854533 1921 ts_manager.cc:194] Registered new tserver with Master: 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481)
I20260619 13:50:52.894889 1388 heartbeater.cc:344] Connected to a master server at 127.0.105.124:40279
I20260619 13:50:52.897199 1921 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" instance_seqno: 1781877043287674) as {username='slave'} at 127.0.105.67:55847; Asking this server to re-register.
I20260619 13:50:52.897915 1388 heartbeater.cc:461] Registering TS with master...
I20260619 13:50:52.899541 1921 ts_manager.cc:194] Registered new tserver with Master: d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
I20260619 13:50:53.045229 1961 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:50:53.045588 1961 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:53.047523 1961 leader_election.cc:290] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003)
W20260619 13:50:53.048471 1907 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
W20260619 13:50:53.050639 1907 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
I20260619 13:50:53.054625 1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 33 } } ignore_live_leader: false dest_uuid: "fe5c828398bf4cd592f4a0b084a304b7" is_pre_election: true
I20260619 13:50:53.054944 1559 raft_consensus.cc:2410] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6184e94a3ec241bfa8d2e34ea579f8a6 for term 4 because replica has last-logged OpId of term: 3 index: 37, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 33.
I20260619 13:50:53.055735 1907 leader_election.cc:304] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6184e94a3ec241bfa8d2e34ea579f8a6; no voters: 7adca601777549878be161a6116e53b6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:50:53.056180 1961 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260619 13:50:53.298414 1984 raft_consensus.cc:493] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7adca601777549878be161a6116e53b6)
I20260619 13:50:53.298662 1984 raft_consensus.cc:515] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:53.299643 1984 leader_election.cc:290] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
I20260619 13:50:53.310789 1931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fe5c828398bf4cd592f4a0b084a304b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 37 } } ignore_live_leader: false dest_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" is_pre_election: true
I20260619 13:50:53.311407 1931 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe5c828398bf4cd592f4a0b084a304b7 in term 3.
I20260619 13:50:53.311987 1529 leader_election.cc:304] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7; no voters:
I20260619 13:50:53.312422 1984 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260619 13:50:53.312604 1984 raft_consensus.cc:493] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7adca601777549878be161a6116e53b6)
I20260619 13:50:53.312804 1984 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 3 FOLLOWER]: Advancing to term 4
W20260619 13:50:53.313621 1531 leader_election.cc:336] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
I20260619 13:50:53.315316 1984 raft_consensus.cc:515] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:53.316018 1984 leader_election.cc:290] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 election: Requested vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
I20260619 13:50:53.316640 1931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fe5c828398bf4cd592f4a0b084a304b7" candidate_term: 4 candidate_status { last_received { term: 3 index: 37 } } ignore_live_leader: false dest_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6"
I20260619 13:50:53.316862 1931 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 3 FOLLOWER]: Advancing to term 4
W20260619 13:50:53.317570 1531 leader_election.cc:336] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
I20260619 13:50:53.320529 1931 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe5c828398bf4cd592f4a0b084a304b7 in term 4.
I20260619 13:50:53.320992 1529 leader_election.cc:304] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7; no voters: 7adca601777549878be161a6116e53b6
I20260619 13:50:53.321341 1984 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 4 FOLLOWER]: Leader election won for term 4
I20260619 13:50:53.321802 1984 raft_consensus.cc:697] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 4 LEADER]: Becoming Leader. State: Replica: fe5c828398bf4cd592f4a0b084a304b7, State: Running, Role: LEADER
I20260619 13:50:53.322244 1984 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 37, Committed index: 37, Last appended: 3.37, Last appended by leader: 37, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:53.323881 1988 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe5c828398bf4cd592f4a0b084a304b7. Latest consensus state: current_term: 4 leader_uuid: "fe5c828398bf4cd592f4a0b084a304b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:53.324213 1988 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: This master's current role is: LEADER
I20260619 13:50:53.324957 1990 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260619 13:50:53.327487 1990 catalog_manager.cc:679] Loaded metadata for table default.table_1623c8da7f1e42958362607cf3bed6f0 [id=2d3dc93800df4ce7bcaa51ca2d5172eb]
I20260619 13:50:53.327920 1990 catalog_manager.cc:679] Loaded metadata for table default.table_06260aeaf35a4709a2f2596a0268c737 [id=2f052b286bee49df9c7ae8cd8ecfd90b]
I20260619 13:50:53.328227 1990 catalog_manager.cc:679] Loaded metadata for table default.table_2138876d1fe74e81bfc560e2fb592a0e [id=57c8bf0937b84407ace807934df053c4]
I20260619 13:50:53.328549 1990 catalog_manager.cc:679] Loaded metadata for table default.table_08f0dacfa3d348c9ab0e8387f52e681a [id=7774d59813b44a19864817d47194e724]
I20260619 13:50:53.328835 1990 catalog_manager.cc:679] Loaded metadata for table default.table_71421a29531045198619e2e3d9383268 [id=8385a644150b489d9d4f61e2338d081e]
I20260619 13:50:53.329123 1990 catalog_manager.cc:679] Loaded metadata for table default.table_c1ef2fe395ec45c98ee34472a137d486 [id=9aea7bf089c54100afe5510f3b4ec4ae]
I20260619 13:50:53.329401 1990 catalog_manager.cc:679] Loaded metadata for table default.table_75fff73b19164084879700104d9a214c [id=c250a119cf6642b2ad489636485fceac]
I20260619 13:50:53.329847 1990 catalog_manager.cc:679] Loaded metadata for table default.table_6a76b7745ccc406facfc1fc1021b24d9 [id=d0fb54a9a55b4a3b83f7c809ef7d24ea]
I20260619 13:50:53.330178 1990 catalog_manager.cc:679] Loaded metadata for table default.table_8ba4a12b36bd4159a70fe23f31c1e862 [id=e009fdd5a6e2488f9f7bfa3ed6005316]
I20260619 13:50:53.332226 1990 tablet_loader.cc:96] loaded metadata for tablet 3491c8ba98ae45c1a6ba15a03d9d55f2 (table default.table_2138876d1fe74e81bfc560e2fb592a0e [id=57c8bf0937b84407ace807934df053c4])
I20260619 13:50:53.332784 1990 tablet_loader.cc:96] loaded metadata for tablet 99b7f1f73b6449698c36f420002318f6 (table default.table_c1ef2fe395ec45c98ee34472a137d486 [id=9aea7bf089c54100afe5510f3b4ec4ae])
I20260619 13:50:53.333258 1990 tablet_loader.cc:96] loaded metadata for tablet afd1f4707bec4f61b6001eb88426f985 (table default.table_06260aeaf35a4709a2f2596a0268c737 [id=2f052b286bee49df9c7ae8cd8ecfd90b])
I20260619 13:50:53.333729 1990 tablet_loader.cc:96] loaded metadata for tablet b1cf3f5226e7408d8eadb8d0fb670d7b (table default.table_6a76b7745ccc406facfc1fc1021b24d9 [id=d0fb54a9a55b4a3b83f7c809ef7d24ea])
I20260619 13:50:53.334151 1990 tablet_loader.cc:96] loaded metadata for tablet bf536238326544e7ba59cc441da29696 (table default.table_08f0dacfa3d348c9ab0e8387f52e681a [id=7774d59813b44a19864817d47194e724])
I20260619 13:50:53.334563 1990 tablet_loader.cc:96] loaded metadata for tablet c72a70b85f464558a625e293380f610b (table default.table_8ba4a12b36bd4159a70fe23f31c1e862 [id=e009fdd5a6e2488f9f7bfa3ed6005316])
I20260619 13:50:53.335315 1990 tablet_loader.cc:96] loaded metadata for tablet d66b1eaa29454bb3bc8e2c493d01cb43 (table default.table_1623c8da7f1e42958362607cf3bed6f0 [id=2d3dc93800df4ce7bcaa51ca2d5172eb])
I20260619 13:50:53.335721 1990 tablet_loader.cc:96] loaded metadata for tablet d7f76b3a50b24ef380870ccd67510d57 (table default.table_71421a29531045198619e2e3d9383268 [id=8385a644150b489d9d4f61e2338d081e])
I20260619 13:50:53.336045 1990 tablet_loader.cc:96] loaded metadata for tablet e637f2b405c445a1afee9cd9c9db8d08 (table default.table_75fff73b19164084879700104d9a214c [id=c250a119cf6642b2ad489636485fceac])
I20260619 13:50:53.336532 1990 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260619 13:50:53.337714 1990 catalog_manager.cc:1294] Loaded cluster ID: 83fe01e7c5804ae9b7b2307f12c08ec9
I20260619 13:50:53.337816 1990 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260619 13:50:53.339049 1990 catalog_manager.cc:1539] Loading token signing keys...
I20260619 13:50:53.339913 1990 catalog_manager.cc:6080] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: Loaded TSK: 0
I20260619 13:50:53.340785 1990 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260619 13:50:53.341653 1990 catalog_manager.cc:1562] Loading latest processed Hive Metastore notification log event ID...
I20260619 13:50:53.342420 1990 catalog_manager.cc:5918] Last processed Hive Metastore notification event ID: -1
I20260619 13:50:53.456013 1548 master_service.cc:960] ReplaceTablet: received request to replace tablet 3491c8ba98ae45c1a6ba15a03d9d55f2 from {username='slave'} at 127.0.0.1:58792
I20260619 13:50:53.456440 1549 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58792:
name: "default.Table_387aecac34f04c43a7bf701eff348112"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:53.456569 1546 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58792:
name: "default.Table_93c2826cde41498d8b9d82f106824c41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:53.457304 1543 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58792:
table { table_name: "default.Table_6a76b7745ccc406facfc1fc1021b24d9" } new_table_name: "default.Table_9264d7b88c28449596f35c4e444713b8" modify_external_catalogs: true
I20260619 13:50:53.457374 1547 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58792:
name: "default.Table_8c43993fce7349e49137eb5cb7ed4fc7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:53.457329 1540 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58792:
name: "default.Table_59c8023d6dec4ca985120f5dbf942dc8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:50:53.457969 1542 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58792:
table { table_name: "default.Table_2138876d1fe74e81bfc560e2fb592a0e" } new_table_name: "default.Table_a2e4bb5b93bf49e1aa8c0181d2b1a362" modify_external_catalogs: true
I20260619 13:50:53.458015 1544 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58792:
table { table_name: "default.Table_75fff73b19164084879700104d9a214c" } new_table_name: "default.Table_f424e0ef22ac4d4492d2ca6a9b24d277" modify_external_catalogs: true
I20260619 13:50:53.458469 1541 master_service.cc:960] ReplaceTablet: received request to replace tablet 0fd56579c7a44155a0090e2720566a58 from {username='slave'} at 127.0.0.1:58792
I20260619 13:50:53.458500 1545 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58792:
table { table_name: "default.Table_1623c8da7f1e42958362607cf3bed6f0" } new_table_name: "default.Table_5fdb6be1506543aab7b2548398b26c61" modify_external_catalogs: true
I20260619 13:50:53.459576 1541 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58792:
table { table_name: "default.Table_08f0dacfa3d348c9ab0e8387f52e681a" } modify_external_catalogs: true
I20260619 13:50:53.459822 1541 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58792:
table { table_name: "default.Table_08f0dacfa3d348c9ab0e8387f52e681a" } modify_external_catalogs: true
I20260619 13:50:53.464401 1931 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 4 FOLLOWER]: Refusing update from remote peer fe5c828398bf4cd592f4a0b084a304b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 33. Preceding OpId from leader: term: 4 index: 39. (index mismatch)
I20260619 13:50:53.465794 1988 consensus_queue.cc:1048] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 38, Last known committed idx: 33, Time since last communication: 0.000s
W20260619 13:50:53.467029 1531 consensus_peers.cc:597] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 -> Peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Couldn't send request to peer 7adca601777549878be161a6116e53b6. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
F20260619 13:50:53.468101 1624 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 1, previous 1; dumping first 2 out of 10 received events: NotificationEvent(eventId=1, eventTime=1781877043, eventType=CREATE_TABLE, dbName=default, tableName=table_2138876d1fe74e81bfc560e2fb592a0e, message={"server":"","servicePrincipal":"","db":"default","table":"table_2138876d1fe74e81bfc560e2fb592a0e","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_2138876d1fe74e81bfc560e2fb592a0e\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1781877043},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/warehouse/table_2138876d1fe74e81bfc560e2fb592a0e\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_2138876d1fe74e81bfc560e2fb592a0e\",\"kudu.table_id\":\"57c8bf0937b84407ace807934df053c4\",\"transient_lastDdlTime\":\"1781877043\",\"comment\":\"\",\"kudu.master_addresses\":\"127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"83fe01e7c5804ae9b7b2307f12c08ec9\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1781877043,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=1, eventTime=1781877043, eventType=CREATE_TABLE, dbName=default, tableName=table_c52ddc84a5e24c718eba7aab2234f558, message={"server":"","servicePrincipal":"","db":"default","table":"table_c52ddc84a5e24c718eba7aab2234f558","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_c52ddc84a5e24c718eba7aab2234f558\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1781877043},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/warehouse/table_c52ddc84a5e24c718eba7aab2234f558\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_c52ddc84a5e24c718eba7aab2234f558\",\"kudu.table_id\":\"b3b37daaec8c448a98386eb208b2cd04\",\"transient_lastDdlTime\":\"1781877043\",\"comment\":\"\",\"kudu.master_addresses\":\"127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"83fe01e7c5804ae9b7b2307f12c08ec9\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1781877043,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7fb8b1c33dcd google::LogMessage::Fail() at ??:0
@ 0x7fb8b1c37b93 google::LogMessage::SendToLog() at ??:0
@ 0x7fb8b1c337cc google::LogMessage::Flush() at ??:0
@ 0x7fb8b1c33a11 google::LogMessage::~LogMessage() at ??:0
@ 0x7fb8c882e394 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260619 13:50:53.485864 1961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe5c828398bf4cd592f4a0b084a304b7. Latest consensus state: current_term: 4 leader_uuid: "fe5c828398bf4cd592f4a0b084a304b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:53.486218 1961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 13:50:53.486621 1995 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "fe5c828398bf4cd592f4a0b084a304b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:53.486963 1995 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 13:50:53.488240 1992 mvcc.cc:204] Tried to move back new op lower bound from 7298568381262237696 to 7298568380934483968. Current Snapshot: MvccSnapshot[applied={T|T < 7298568381262237696}]
@ 0x7fb8c882cc41 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260619 13:50:53.489570 1984 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "fe5c828398bf4cd592f4a0b084a304b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:53.489866 1984 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: This master's current role is: LEADER
I20260619 13:50:53.490170 1995 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "fe5c828398bf4cd592f4a0b084a304b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:53.490343 1995 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 13:50:53.490458 1548 catalog_manager.cc:5983] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: Sending DeleteTablet for 3 replicas of tablet 3491c8ba98ae45c1a6ba15a03d9d55f2
I20260619 13:50:53.492548 1548 catalog_manager.cc:6784] ReplaceTablet: tablet 3491c8ba98ae45c1a6ba15a03d9d55f2 deleted and replaced by tablet da2d71631f364b6e86a17e113d7e8960
I20260619 13:50:53.492956 1548 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58792:
name: "default.Table_04077192a2444da49f04c39c741733bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
@ 0x7fb8c88348bc kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260619 13:50:53.509478 1322 tablet_service.cc:1558] Processing DeleteTablet for tablet 3491c8ba98ae45c1a6ba15a03d9d55f2 with delete_type TABLET_DATA_DELETED (replaced by tablet da2d71631f364b6e86a17e113d7e8960) from {username='slave'} at 127.0.0.1:50318
@ 0x7fb8c8834739 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa681d std::function<>::operator()() at ??:?
I20260619 13:50:53.518131 2008 tablet_replica.cc:333] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P d54f30d62f034b35a8e73ff525ba43d9: stopping tablet replica
I20260619 13:50:53.518168 1047 tablet_service.cc:1558] Processing DeleteTablet for tablet 3491c8ba98ae45c1a6ba15a03d9d55f2 with delete_type TABLET_DATA_DELETED (replaced by tablet da2d71631f364b6e86a17e113d7e8960) from {username='slave'} at 127.0.0.1:57124
I20260619 13:50:53.518457 2008 raft_consensus.cc:2243] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P d54f30d62f034b35a8e73ff525ba43d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 13:50:53.518733 2008 raft_consensus.cc:2272] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P d54f30d62f034b35a8e73ff525ba43d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 13:50:53.519459 2008 ts_tablet_manager.cc:1916] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P d54f30d62f034b35a8e73ff525ba43d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 13:50:53.525084 1184 tablet_service.cc:1558] Processing DeleteTablet for tablet 3491c8ba98ae45c1a6ba15a03d9d55f2 with delete_type TABLET_DATA_DELETED (replaced by tablet da2d71631f364b6e86a17e113d7e8960) from {username='slave'} at 127.0.0.1:45930
I20260619 13:50:53.525990 2012 tablet_replica.cc:333] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16: stopping tablet replica
I20260619 13:50:53.526232 2012 raft_consensus.cc:2243] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16 [term 1 LEADER]: Raft consensus shutting down.
I20260619 13:50:53.526834 2012 raft_consensus.cc:2272] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 13:50:53.527501 2012 ts_tablet_manager.cc:1916] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 13:50:53.529438 2008 ts_tablet_manager.cc:1929] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P d54f30d62f034b35a8e73ff525ba43d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 13:50:53.529608 2008 log.cc:1199] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P d54f30d62f034b35a8e73ff525ba43d9: Deleting WAL directory at /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-2/wal/wals/3491c8ba98ae45c1a6ba15a03d9d55f2
I20260619 13:50:53.530045 2008 ts_tablet_manager.cc:1950] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P d54f30d62f034b35a8e73ff525ba43d9: Deleting consensus metadata
@ 0x7fb8b495af49 kudu::Thread::SuperviseThread() at ??:0
I20260619 13:50:53.531558 1532 catalog_manager.cc:5027] TS d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): tablet 3491c8ba98ae45c1a6ba15a03d9d55f2 (table default.table_2138876d1fe74e81bfc560e2fb592a0e [id=57c8bf0937b84407ace807934df053c4]) successfully deleted
I20260619 13:50:53.533794 1046 tablet_service.cc:1511] Processing CreateTablet for tablet 99b7f1f73b6449698c36f420002318f6 (DEFAULT_TABLE table=default.table_c1ef2fe395ec45c98ee34472a137d486 [id=9aea7bf089c54100afe5510f3b4ec4ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:53.534269 1046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99b7f1f73b6449698c36f420002318f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:53.535099 1184 tablet_service.cc:1511] Processing CreateTablet for tablet 99b7f1f73b6449698c36f420002318f6 (DEFAULT_TABLE table=default.table_c1ef2fe395ec45c98ee34472a137d486 [id=9aea7bf089c54100afe5510f3b4ec4ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:53.535758 1184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99b7f1f73b6449698c36f420002318f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:53.535815 2012 ts_tablet_manager.cc:1929] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 13:50:53.535938 2012 log.cc:1199] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16: Deleting WAL directory at /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-1/wal/wals/3491c8ba98ae45c1a6ba15a03d9d55f2
I20260619 13:50:53.536389 2012 ts_tablet_manager.cc:1950] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 94599283b9334819b3bbe25509b7cd16: Deleting consensus metadata
I20260619 13:50:53.537781 1530 catalog_manager.cc:5027] TS 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): tablet 3491c8ba98ae45c1a6ba15a03d9d55f2 (table default.table_2138876d1fe74e81bfc560e2fb592a0e [id=57c8bf0937b84407ace807934df053c4]) successfully deleted
I20260619 13:50:53.540361 2010 tablet_replica.cc:333] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 380c26fd105f454cbe8ef6b87e35f41f: stopping tablet replica
I20260619 13:50:53.540591 2010 raft_consensus.cc:2243] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 380c26fd105f454cbe8ef6b87e35f41f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 13:50:53.540825 2010 raft_consensus.cc:2272] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 380c26fd105f454cbe8ef6b87e35f41f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 13:50:53.541419 2010 ts_tablet_manager.cc:1916] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 380c26fd105f454cbe8ef6b87e35f41f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 13:50:53.544652 1048 tablet_service.cc:1511] Processing CreateTablet for tablet da2d71631f364b6e86a17e113d7e8960 (DEFAULT_TABLE table=default.table_2138876d1fe74e81bfc560e2fb592a0e [id=57c8bf0937b84407ace807934df053c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:53.545078 1185 tablet_service.cc:1511] Processing CreateTablet for tablet da2d71631f364b6e86a17e113d7e8960 (DEFAULT_TABLE table=default.table_2138876d1fe74e81bfc560e2fb592a0e [id=57c8bf0937b84407ace807934df053c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:53.545254 1048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da2d71631f364b6e86a17e113d7e8960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:53.545843 1185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da2d71631f364b6e86a17e113d7e8960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:53.545852 1322 tablet_service.cc:1511] Processing CreateTablet for tablet 99b7f1f73b6449698c36f420002318f6 (DEFAULT_TABLE table=default.table_c1ef2fe395ec45c98ee34472a137d486 [id=9aea7bf089c54100afe5510f3b4ec4ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:53.546237 1322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99b7f1f73b6449698c36f420002318f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:53.549273 2010 ts_tablet_manager.cc:1929] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 380c26fd105f454cbe8ef6b87e35f41f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 13:50:53.549407 2010 log.cc:1199] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 380c26fd105f454cbe8ef6b87e35f41f: Deleting WAL directory at /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-0/wal/wals/3491c8ba98ae45c1a6ba15a03d9d55f2
I20260619 13:50:53.549677 1321 tablet_service.cc:1511] Processing CreateTablet for tablet da2d71631f364b6e86a17e113d7e8960 (DEFAULT_TABLE table=default.table_2138876d1fe74e81bfc560e2fb592a0e [id=57c8bf0937b84407ace807934df053c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:50:53.550168 1321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da2d71631f364b6e86a17e113d7e8960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:50:53.550253 2010 ts_tablet_manager.cc:1950] T 3491c8ba98ae45c1a6ba15a03d9d55f2 P 380c26fd105f454cbe8ef6b87e35f41f: Deleting consensus metadata
I20260619 13:50:53.551432 1531 catalog_manager.cc:5027] TS 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): tablet 3491c8ba98ae45c1a6ba15a03d9d55f2 (table default.table_2138876d1fe74e81bfc560e2fb592a0e [id=57c8bf0937b84407ace807934df053c4]) successfully deleted
I20260619 13:50:53.555503 2018 tablet_bootstrap.cc:492] T da2d71631f364b6e86a17e113d7e8960 P d54f30d62f034b35a8e73ff525ba43d9: Bootstrap starting.
I20260619 13:50:53.557420 2018 tablet_bootstrap.cc:654] T da2d71631f364b6e86a17e113d7e8960 P d54f30d62f034b35a8e73ff525ba43d9: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:53.561321 2017 tablet_bootstrap.cc:492] T 99b7f1f73b6449698c36f420002318f6 P 94599283b9334819b3bbe25509b7cd16: Bootstrap starting.
I20260619 13:50:53.564761 2017 tablet_bootstrap.cc:654] T 99b7f1f73b6449698c36f420002318f6 P 94599283b9334819b3bbe25509b7cd16: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:53.565811 2018 tablet_bootstrap.cc:492] T da2d71631f364b6e86a17e113d7e8960 P d54f30d62f034b35a8e73ff525ba43d9: No bootstrap required, opened a new log
I20260619 13:50:53.566052 2018 ts_tablet_manager.cc:1403] T da2d71631f364b6e86a17e113d7e8960 P d54f30d62f034b35a8e73ff525ba43d9: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.005s
I20260619 13:50:53.567189 2018 raft_consensus.cc:359] T da2d71631f364b6e86a17e113d7e8960 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:53.567478 2018 raft_consensus.cc:385] T da2d71631f364b6e86a17e113d7e8960 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:53.567602 2018 raft_consensus.cc:740] T da2d71631f364b6e86a17e113d7e8960 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f30d62f034b35a8e73ff525ba43d9, State: Initialized, Role: FOLLOWER
I20260619 13:50:53.568017 2018 consensus_queue.cc:260] T da2d71631f364b6e86a17e113d7e8960 P d54f30d62f034b35a8e73ff525ba43d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:53.571413 2016 tablet_bootstrap.cc:492] T 99b7f1f73b6449698c36f420002318f6 P 380c26fd105f454cbe8ef6b87e35f41f: Bootstrap starting.
I20260619 13:50:53.571614 2018 ts_tablet_manager.cc:1434] T da2d71631f364b6e86a17e113d7e8960 P d54f30d62f034b35a8e73ff525ba43d9: Time spent starting tablet: real 0.005s user 0.002s sys 0.002s
@ 0x7fb8b80246db start_thread at ??:0
I20260619 13:50:53.573148 1390 heartbeater.cc:499] Master 127.0.105.125:37003 was elected leader, sending a full tablet report...
I20260619 13:50:53.574360 2016 tablet_bootstrap.cc:654] T 99b7f1f73b6449698c36f420002318f6 P 380c26fd105f454cbe8ef6b87e35f41f: Neither blocks nor log segments found. Creating new log.
@ 0x7fb8b0ae261f clone at ??:0
I20260619 13:50:53.582261 2017 tablet_bootstrap.cc:492] T 99b7f1f73b6449698c36f420002318f6 P 94599283b9334819b3bbe25509b7cd16: No bootstrap required, opened a new log
I20260619 13:50:53.582432 2017 ts_tablet_manager.cc:1403] T 99b7f1f73b6449698c36f420002318f6 P 94599283b9334819b3bbe25509b7cd16: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.002s
I20260619 13:50:53.583295 2017 raft_consensus.cc:359] T 99b7f1f73b6449698c36f420002318f6 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:53.583521 2017 raft_consensus.cc:385] T 99b7f1f73b6449698c36f420002318f6 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:53.583612 2017 raft_consensus.cc:740] T 99b7f1f73b6449698c36f420002318f6 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94599283b9334819b3bbe25509b7cd16, State: Initialized, Role: FOLLOWER
I20260619 13:50:53.583894 2017 consensus_queue.cc:260] T 99b7f1f73b6449698c36f420002318f6 P 94599283b9334819b3bbe25509b7cd16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:53.584376 1252 heartbeater.cc:499] Master 127.0.105.125:37003 was elected leader, sending a full tablet report...
I20260619 13:50:53.585577 2016 tablet_bootstrap.cc:492] T 99b7f1f73b6449698c36f420002318f6 P 380c26fd105f454cbe8ef6b87e35f41f: No bootstrap required, opened a new log
I20260619 13:50:53.585737 2016 ts_tablet_manager.cc:1403] T 99b7f1f73b6449698c36f420002318f6 P 380c26fd105f454cbe8ef6b87e35f41f: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.001s
I20260619 13:50:53.586206 2018 tablet_bootstrap.cc:492] T 99b7f1f73b6449698c36f420002318f6 P d54f30d62f034b35a8e73ff525ba43d9: Bootstrap starting.
I20260619 13:50:53.587699 2017 ts_tablet_manager.cc:1434] T 99b7f1f73b6449698c36f420002318f6 P 94599283b9334819b3bbe25509b7cd16: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260619 13:50:53.587999 2018 tablet_bootstrap.cc:654] T 99b7f1f73b6449698c36f420002318f6 P d54f30d62f034b35a8e73ff525ba43d9: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:53.590245 2016 raft_consensus.cc:359] T 99b7f1f73b6449698c36f420002318f6 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:53.590443 2016 raft_consensus.cc:385] T 99b7f1f73b6449698c36f420002318f6 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:53.590534 2016 raft_consensus.cc:740] T 99b7f1f73b6449698c36f420002318f6 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 380c26fd105f454cbe8ef6b87e35f41f, State: Initialized, Role: FOLLOWER
I20260619 13:50:53.590765 2016 consensus_queue.cc:260] T 99b7f1f73b6449698c36f420002318f6 P 380c26fd105f454cbe8ef6b87e35f41f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:53.591367 2017 tablet_bootstrap.cc:492] T da2d71631f364b6e86a17e113d7e8960 P 94599283b9334819b3bbe25509b7cd16: Bootstrap starting.
I20260619 13:50:53.593582 2017 tablet_bootstrap.cc:654] T da2d71631f364b6e86a17e113d7e8960 P 94599283b9334819b3bbe25509b7cd16: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:53.596195 2018 tablet_bootstrap.cc:492] T 99b7f1f73b6449698c36f420002318f6 P d54f30d62f034b35a8e73ff525ba43d9: No bootstrap required, opened a new log
I20260619 13:50:53.596388 2018 ts_tablet_manager.cc:1403] T 99b7f1f73b6449698c36f420002318f6 P d54f30d62f034b35a8e73ff525ba43d9: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.005s
I20260619 13:50:53.597326 2018 raft_consensus.cc:359] T 99b7f1f73b6449698c36f420002318f6 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:53.597604 2018 raft_consensus.cc:385] T 99b7f1f73b6449698c36f420002318f6 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:53.597687 2018 raft_consensus.cc:740] T 99b7f1f73b6449698c36f420002318f6 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f30d62f034b35a8e73ff525ba43d9, State: Initialized, Role: FOLLOWER
I20260619 13:50:53.597999 2018 consensus_queue.cc:260] T 99b7f1f73b6449698c36f420002318f6 P d54f30d62f034b35a8e73ff525ba43d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:53.598469 2018 ts_tablet_manager.cc:1434] T 99b7f1f73b6449698c36f420002318f6 P d54f30d62f034b35a8e73ff525ba43d9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 13:50:53.600677 2017 tablet_bootstrap.cc:492] T da2d71631f364b6e86a17e113d7e8960 P 94599283b9334819b3bbe25509b7cd16: No bootstrap required, opened a new log
I20260619 13:50:53.600867 2017 ts_tablet_manager.cc:1403] T da2d71631f364b6e86a17e113d7e8960 P 94599283b9334819b3bbe25509b7cd16: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.003s
I20260619 13:50:53.598183 2016 ts_tablet_manager.cc:1434] T 99b7f1f73b6449698c36f420002318f6 P 380c26fd105f454cbe8ef6b87e35f41f: Time spent starting tablet: real 0.012s user 0.001s sys 0.003s
I20260619 13:50:53.601703 2017 raft_consensus.cc:359] T da2d71631f364b6e86a17e113d7e8960 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:53.601933 2017 raft_consensus.cc:385] T da2d71631f364b6e86a17e113d7e8960 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:53.602038 2017 raft_consensus.cc:740] T da2d71631f364b6e86a17e113d7e8960 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94599283b9334819b3bbe25509b7cd16, State: Initialized, Role: FOLLOWER
I20260619 13:50:53.602361 2017 consensus_queue.cc:260] T da2d71631f364b6e86a17e113d7e8960 P 94599283b9334819b3bbe25509b7cd16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:53.603806 2016 tablet_bootstrap.cc:492] T da2d71631f364b6e86a17e113d7e8960 P 380c26fd105f454cbe8ef6b87e35f41f: Bootstrap starting.
I20260619 13:50:53.605723 2016 tablet_bootstrap.cc:654] T da2d71631f364b6e86a17e113d7e8960 P 380c26fd105f454cbe8ef6b87e35f41f: Neither blocks nor log segments found. Creating new log.
I20260619 13:50:53.607853 2017 ts_tablet_manager.cc:1434] T da2d71631f364b6e86a17e113d7e8960 P 94599283b9334819b3bbe25509b7cd16: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260619 13:50:53.612260 2016 tablet_bootstrap.cc:492] T da2d71631f364b6e86a17e113d7e8960 P 380c26fd105f454cbe8ef6b87e35f41f: No bootstrap required, opened a new log
I20260619 13:50:53.612473 2016 ts_tablet_manager.cc:1403] T da2d71631f364b6e86a17e113d7e8960 P 380c26fd105f454cbe8ef6b87e35f41f: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260619 13:50:53.613135 2016 raft_consensus.cc:359] T da2d71631f364b6e86a17e113d7e8960 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:53.613299 2016 raft_consensus.cc:385] T da2d71631f364b6e86a17e113d7e8960 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:50:53.613405 2016 raft_consensus.cc:740] T da2d71631f364b6e86a17e113d7e8960 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 380c26fd105f454cbe8ef6b87e35f41f, State: Initialized, Role: FOLLOWER
I20260619 13:50:53.613678 2016 consensus_queue.cc:260] T da2d71631f364b6e86a17e113d7e8960 P 380c26fd105f454cbe8ef6b87e35f41f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:53.614178 2016 ts_tablet_manager.cc:1434] T da2d71631f364b6e86a17e113d7e8960 P 380c26fd105f454cbe8ef6b87e35f41f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 13:50:53.658146 2028 raft_consensus.cc:493] T 99b7f1f73b6449698c36f420002318f6 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:50:53.658392 2028 raft_consensus.cc:515] T 99b7f1f73b6449698c36f420002318f6 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:53.659163 2028 leader_election.cc:290] T 99b7f1f73b6449698c36f420002318f6 P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
I20260619 13:50:53.659787 1342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b7f1f73b6449698c36f420002318f6" candidate_uuid: "380c26fd105f454cbe8ef6b87e35f41f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f30d62f034b35a8e73ff525ba43d9" is_pre_election: true
I20260619 13:50:53.659828 1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b7f1f73b6449698c36f420002318f6" candidate_uuid: "380c26fd105f454cbe8ef6b87e35f41f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94599283b9334819b3bbe25509b7cd16" is_pre_election: true
I20260619 13:50:53.660063 1342 raft_consensus.cc:2468] T 99b7f1f73b6449698c36f420002318f6 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 380c26fd105f454cbe8ef6b87e35f41f in term 0.
I20260619 13:50:53.660079 1205 raft_consensus.cc:2468] T 99b7f1f73b6449698c36f420002318f6 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 380c26fd105f454cbe8ef6b87e35f41f in term 0.
I20260619 13:50:53.660687 1002 leader_election.cc:304] T 99b7f1f73b6449698c36f420002318f6 P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f, 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9; no voters:
I20260619 13:50:53.661077 2028 raft_consensus.cc:2804] T 99b7f1f73b6449698c36f420002318f6 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 13:50:53.661217 2028 raft_consensus.cc:493] T 99b7f1f73b6449698c36f420002318f6 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 13:50:53.661319 2028 raft_consensus.cc:3060] T 99b7f1f73b6449698c36f420002318f6 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:53.664014 2028 raft_consensus.cc:515] T 99b7f1f73b6449698c36f420002318f6 P 380c26fd105f454cbe8ef6b87e35f41f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:53.664685 2028 leader_election.cc:290] T 99b7f1f73b6449698c36f420002318f6 P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 election: Requested vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
I20260619 13:50:53.665300 1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b7f1f73b6449698c36f420002318f6" candidate_uuid: "380c26fd105f454cbe8ef6b87e35f41f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94599283b9334819b3bbe25509b7cd16"
I20260619 13:50:53.665280 1342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b7f1f73b6449698c36f420002318f6" candidate_uuid: "380c26fd105f454cbe8ef6b87e35f41f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f30d62f034b35a8e73ff525ba43d9"
I20260619 13:50:53.665545 1205 raft_consensus.cc:3060] T 99b7f1f73b6449698c36f420002318f6 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:53.665539 1342 raft_consensus.cc:3060] T 99b7f1f73b6449698c36f420002318f6 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:53.668363 1342 raft_consensus.cc:2468] T 99b7f1f73b6449698c36f420002318f6 P d54f30d62f034b35a8e73ff525ba43d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 380c26fd105f454cbe8ef6b87e35f41f in term 1.
I20260619 13:50:53.668397 1205 raft_consensus.cc:2468] T 99b7f1f73b6449698c36f420002318f6 P 94599283b9334819b3bbe25509b7cd16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 380c26fd105f454cbe8ef6b87e35f41f in term 1.
I20260619 13:50:53.668903 1004 leader_election.cc:304] T 99b7f1f73b6449698c36f420002318f6 P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f, d54f30d62f034b35a8e73ff525ba43d9; no voters:
I20260619 13:50:53.669239 2028 raft_consensus.cc:2804] T 99b7f1f73b6449698c36f420002318f6 P 380c26fd105f454cbe8ef6b87e35f41f [term 1 FOLLOWER]: Leader election won for term 1
I20260619 13:50:53.669807 2028 raft_consensus.cc:697] T 99b7f1f73b6449698c36f420002318f6 P 380c26fd105f454cbe8ef6b87e35f41f [term 1 LEADER]: Becoming Leader. State: Replica: 380c26fd105f454cbe8ef6b87e35f41f, State: Running, Role: LEADER
I20260619 13:50:53.670162 2028 consensus_queue.cc:237] T 99b7f1f73b6449698c36f420002318f6 P 380c26fd105f454cbe8ef6b87e35f41f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
W20260619 13:50:53.779313 1276 connection.cc:573] server connection from 127.0.0.1:50318 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 13:50:53.779470 1140 connection.cc:573] client connection to 127.0.105.125:37003 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 13:50:53.779559 1397 connection.cc:573] client connection to 127.0.105.125:37003 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 13:50:53.780280 1397 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.105.125:37003)
W20260619 13:50:53.780652 1397 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.105.125:37003)
W20260619 13:50:53.780805 1397 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.105.125:37003)
W20260619 13:50:53.781293 1397 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.105.125:37003)
W20260619 13:50:53.782879 1003 connection.cc:573] client connection to 127.0.105.125:37003 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 13:50:53.782889 1278 connection.cc:573] client connection to 127.0.105.125:37003 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260619 13:50:54.024806 2034 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fe5c828398bf4cd592f4a0b084a304b7)
I20260619 13:50:54.025029 2034 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:54.025876 2034 leader_election.cc:290] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003)
W20260619 13:50:54.027561 1907 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
W20260619 13:50:54.027810 1907 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:50:54.027927 1907 leader_election.cc:304] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6184e94a3ec241bfa8d2e34ea579f8a6; no voters: 7adca601777549878be161a6116e53b6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:50:54.028216 2034 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260619 13:50:54.030939 2028 raft_consensus.cc:493] T da2d71631f364b6e86a17e113d7e8960 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:50:54.031139 2028 raft_consensus.cc:515] T da2d71631f364b6e86a17e113d7e8960 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:54.031867 2028 leader_election.cc:290] T da2d71631f364b6e86a17e113d7e8960 P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
I20260619 13:50:54.032341 1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da2d71631f364b6e86a17e113d7e8960" candidate_uuid: "380c26fd105f454cbe8ef6b87e35f41f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94599283b9334819b3bbe25509b7cd16" is_pre_election: true
I20260619 13:50:54.032441 1342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da2d71631f364b6e86a17e113d7e8960" candidate_uuid: "380c26fd105f454cbe8ef6b87e35f41f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f30d62f034b35a8e73ff525ba43d9" is_pre_election: true
I20260619 13:50:54.032634 1205 raft_consensus.cc:2468] T da2d71631f364b6e86a17e113d7e8960 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 380c26fd105f454cbe8ef6b87e35f41f in term 0.
I20260619 13:50:54.032697 1342 raft_consensus.cc:2468] T da2d71631f364b6e86a17e113d7e8960 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 380c26fd105f454cbe8ef6b87e35f41f in term 0.
I20260619 13:50:54.033085 1002 leader_election.cc:304] T da2d71631f364b6e86a17e113d7e8960 P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f, 94599283b9334819b3bbe25509b7cd16; no voters:
I20260619 13:50:54.033396 2028 raft_consensus.cc:2804] T da2d71631f364b6e86a17e113d7e8960 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 13:50:54.033496 2028 raft_consensus.cc:493] T da2d71631f364b6e86a17e113d7e8960 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 13:50:54.033653 2028 raft_consensus.cc:3060] T da2d71631f364b6e86a17e113d7e8960 P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:54.035589 2028 raft_consensus.cc:515] T da2d71631f364b6e86a17e113d7e8960 P 380c26fd105f454cbe8ef6b87e35f41f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:54.036243 2028 leader_election.cc:290] T da2d71631f364b6e86a17e113d7e8960 P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 election: Requested vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
I20260619 13:50:54.036665 1205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da2d71631f364b6e86a17e113d7e8960" candidate_uuid: "380c26fd105f454cbe8ef6b87e35f41f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94599283b9334819b3bbe25509b7cd16"
I20260619 13:50:54.036785 1342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da2d71631f364b6e86a17e113d7e8960" candidate_uuid: "380c26fd105f454cbe8ef6b87e35f41f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f30d62f034b35a8e73ff525ba43d9"
I20260619 13:50:54.036907 1205 raft_consensus.cc:3060] T da2d71631f364b6e86a17e113d7e8960 P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:54.036983 1342 raft_consensus.cc:3060] T da2d71631f364b6e86a17e113d7e8960 P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:50:54.039731 1342 raft_consensus.cc:2468] T da2d71631f364b6e86a17e113d7e8960 P d54f30d62f034b35a8e73ff525ba43d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 380c26fd105f454cbe8ef6b87e35f41f in term 1.
I20260619 13:50:54.039716 1205 raft_consensus.cc:2468] T da2d71631f364b6e86a17e113d7e8960 P 94599283b9334819b3bbe25509b7cd16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 380c26fd105f454cbe8ef6b87e35f41f in term 1.
I20260619 13:50:54.040232 1004 leader_election.cc:304] T da2d71631f364b6e86a17e113d7e8960 P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f, 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9; no voters:
I20260619 13:50:54.040537 2028 raft_consensus.cc:2804] T da2d71631f364b6e86a17e113d7e8960 P 380c26fd105f454cbe8ef6b87e35f41f [term 1 FOLLOWER]: Leader election won for term 1
I20260619 13:50:54.040768 2028 raft_consensus.cc:697] T da2d71631f364b6e86a17e113d7e8960 P 380c26fd105f454cbe8ef6b87e35f41f [term 1 LEADER]: Becoming Leader. State: Replica: 380c26fd105f454cbe8ef6b87e35f41f, State: Running, Role: LEADER
I20260619 13:50:54.041059 2028 consensus_queue.cc:237] T da2d71631f364b6e86a17e113d7e8960 P 380c26fd105f454cbe8ef6b87e35f41f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:54.424118 2028 consensus_queue.cc:1048] T 99b7f1f73b6449698c36f420002318f6 P 380c26fd105f454cbe8ef6b87e35f41f [LEADER]: Connected to new peer: Peer: permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 13:50:54.428979 2028 consensus_queue.cc:1048] T 99b7f1f73b6449698c36f420002318f6 P 380c26fd105f454cbe8ef6b87e35f41f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 13:50:54.571048 2049 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fe5c828398bf4cd592f4a0b084a304b7)
I20260619 13:50:54.571238 2049 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:54.571851 2049 leader_election.cc:290] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003)
W20260619 13:50:54.574434 1907 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
W20260619 13:50:54.574697 1907 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:50:54.574831 1907 leader_election.cc:304] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6184e94a3ec241bfa8d2e34ea579f8a6; no voters: 7adca601777549878be161a6116e53b6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:50:54.575136 2049 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260619 13:50:54.800591 2028 consensus_queue.cc:1048] T da2d71631f364b6e86a17e113d7e8960 P 380c26fd105f454cbe8ef6b87e35f41f [LEADER]: Connected to new peer: Peer: permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 13:50:54.806279 2031 consensus_queue.cc:1048] T da2d71631f364b6e86a17e113d7e8960 P 380c26fd105f454cbe8ef6b87e35f41f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 13:50:54.978930 421 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu pid 1883
I20260619 13:50:54.995182 1951 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 13:50:55.110294 421 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu with pid 1883
I20260619 13:50:55.296260 2031 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:50:55.296533 2031 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:50:55.297318 2031 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:50:55.298154 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:50:55.298314 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:50:55.298496 1002 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:50:55.298767 2031 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 13:50:55.474004 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 6: this message will repeat every 5th retry.
I20260619 13:50:55.867923 421 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
/tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.124:40279
--webserver_interface=127.0.105.124
--webserver_port=45257
--builtin_ntp_servers=127.0.105.84:41509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--hive_metastore_uris=thrift://127.0.0.1:39807
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260619 13:50:56.222522 2071 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 13:50:56.222875 2071 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 13:50:56.222997 2071 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260619 13:50:56.231855 2071 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 13:50:56.231959 2071 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260619 13:50:56.232050 2071 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 13:50:56.232126 2071 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260619 13:50:56.243016 2071 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.84:41509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:39807
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.124:40279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.105.124
--webserver_port=45257
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 19 Jun 2026 13:43:23 UTC on bdcb31816ec0
build id 12470
ASAN enabled
I20260619 13:50:56.244702 2071 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 13:50:56.246930 2071 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260619 13:50:56.256083 2085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:50:56.256441 2087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:50:56.256085 2084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 13:50:56.257422 2071 server_base.cc:1061] running on GCE node
I20260619 13:50:56.258301 2071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 13:50:56.259891 2071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 13:50:56.261137 2071 hybrid_clock.cc:648] HybridClock initialized: now 1781877056261096 us; error 60 us; skew 500 ppm
I20260619 13:50:56.261608 2071 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 13:50:56.264133 2071 webserver.cc:533] Webserver started at http://127.0.105.124:45257/ using document root <none> and password file <none>
I20260619 13:50:56.264940 2071 fs_manager.cc:362] Metadata directory not provided
I20260619 13:50:56.265089 2071 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 13:50:56.270867 2071 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260619 13:50:56.274013 2093 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 13:50:56.275517 2071 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 13:50:56.275671 2071 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data,/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/wal
uuid: "6184e94a3ec241bfa8d2e34ea579f8a6"
format_stamp: "Formatted at 2026-06-19 13:50:41 on dist-test-slave-7hnr"
I20260619 13:50:56.276398 2071 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 13:50:56.301064 2071 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260619 13:50:56.302064 2071 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 13:50:56.302385 2071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 13:50:56.326386 2071 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.124:40279
I20260619 13:50:56.326395 2145 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.124:40279 every 8 connection(s)
I20260619 13:50:56.328583 2071 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data/info.pb
I20260619 13:50:56.329321 421 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu as pid 2071
I20260619 13:50:56.339295 2147 sys_catalog.cc:263] Verifying existing consensus state
I20260619 13:50:56.344830 2147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: Bootstrap starting.
I20260619 13:50:56.345723 1388 heartbeater.cc:344] Connected to a master server at 127.0.105.124:40279
I20260619 13:50:56.357299 2147 log.cc:826] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: Log is configured to *not* fsync() on all Append() calls
I20260619 13:50:56.390794 2147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=40 overwritten=0 applied=40 ignored=0} inserts{seen=27 ignored=0} mutations{seen=27 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 13:50:56.391597 2147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: Bootstrap complete.
I20260619 13:50:56.397955 2147 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:56.398953 2147 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6184e94a3ec241bfa8d2e34ea579f8a6, State: Initialized, Role: FOLLOWER
I20260619 13:50:56.399741 2147 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 40, Last appended: 4.40, Last appended by leader: 40, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:56.400610 2151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:50:56.400835 2151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 13:50:56.401858 2147 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 13:50:56.414278 2165 catalog_manager.cc:1294] Loaded cluster ID: 83fe01e7c5804ae9b7b2307f12c08ec9
I20260619 13:50:56.414513 2165 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: loading cluster ID for follower catalog manager: success
I20260619 13:50:56.411511 2071 master_runner.cc:187] Error getting master registration for 127.0.105.126:34929: Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111),
I20260619 13:50:56.417568 2071 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:50:56.419029 2165 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: acquiring CA information for follower catalog manager: success
I20260619 13:50:56.421656 2165 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 13:50:56.454883 1113 heartbeater.cc:344] Connected to a master server at 127.0.105.124:40279
I20260619 13:50:56.457257 2110 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" instance_seqno: 1781877042220212) as {username='slave'} at 127.0.105.65:45963; Asking this server to re-register.
I20260619 13:50:56.458194 1113 heartbeater.cc:461] Registering TS with master...
I20260619 13:50:56.460266 2110 ts_manager.cc:194] Registered new tserver with Master: 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865)
I20260619 13:50:56.819303 1250 heartbeater.cc:344] Connected to a master server at 127.0.105.124:40279
I20260619 13:50:56.820758 2110 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "94599283b9334819b3bbe25509b7cd16" instance_seqno: 1781877042768620) as {username='slave'} at 127.0.105.66:34859; Asking this server to re-register.
I20260619 13:50:56.821429 1250 heartbeater.cc:461] Registering TS with master...
I20260619 13:50:56.822865 2110 ts_manager.cc:194] Registered new tserver with Master: 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481)
I20260619 13:50:56.843814 2151 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:50:56.844153 2151 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:56.846326 2151 leader_election.cc:290] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003)
W20260619 13:50:56.847046 2096 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
W20260619 13:50:56.848827 2096 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
W20260619 13:50:56.849094 2096 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:50:56.849226 2096 leader_election.cc:304] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6184e94a3ec241bfa8d2e34ea579f8a6; no voters: 7adca601777549878be161a6116e53b6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:50:56.849644 2151 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260619 13:50:56.850775 2110 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" instance_seqno: 1781877043287674) as {username='slave'} at 127.0.105.67:40349; Asking this server to re-register.
I20260619 13:50:56.851405 1388 heartbeater.cc:461] Registering TS with master...
I20260619 13:50:56.852773 2110 ts_manager.cc:194] Registered new tserver with Master: d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
I20260619 13:50:57.389216 2181 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:50:57.389410 2181 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:57.390225 2181 leader_election.cc:290] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003)
W20260619 13:50:57.397658 2096 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
W20260619 13:50:57.397935 2096 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:50:57.398084 2096 leader_election.cc:304] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6184e94a3ec241bfa8d2e34ea579f8a6; no voters: 7adca601777549878be161a6116e53b6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:50:57.398384 2181 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260619 13:50:58.022188 2193 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:50:58.022442 2193 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:58.023176 2193 leader_election.cc:290] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003)
W20260619 13:50:58.025481 2096 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
W20260619 13:50:58.025825 2096 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:50:58.025964 2096 leader_election.cc:304] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6184e94a3ec241bfa8d2e34ea579f8a6; no voters: 7adca601777549878be161a6116e53b6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:50:58.026255 2193 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260619 13:50:59.451118 2214 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:50:59.451334 2214 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:50:59.452019 2214 leader_election.cc:290] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003)
W20260619 13:50:59.454327 2096 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
W20260619 13:50:59.454557 2096 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:50:59.454696 2096 leader_election.cc:304] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6184e94a3ec241bfa8d2e34ea579f8a6; no voters: 7adca601777549878be161a6116e53b6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:50:59.454957 2214 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260619 13:50:59.539732 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 6: this message will repeat every 5th retry.
I20260619 13:50:59.644439 421 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
/tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.125:37003
--webserver_interface=127.0.105.125
--webserver_port=36357
--builtin_ntp_servers=127.0.105.84:41509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--hive_metastore_uris=thrift://127.0.0.1:39807
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260619 13:51:00.004002 2219 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 13:51:00.004390 2219 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 13:51:00.004549 2219 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260619 13:51:00.013549 2219 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 13:51:00.013660 2219 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260619 13:51:00.013760 2219 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 13:51:00.013860 2219 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260619 13:51:00.026012 2219 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.84:41509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:39807
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.125:37003
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.105.125
--webserver_port=36357
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 19 Jun 2026 13:43:23 UTC on bdcb31816ec0
build id 12470
ASAN enabled
I20260619 13:51:00.027704 2219 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 13:51:00.029677 2219 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260619 13:51:00.039155 2228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:51:00.039399 2227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:51:00.039973 2230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 13:51:00.040284 2219 server_base.cc:1061] running on GCE node
I20260619 13:51:00.041185 2219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 13:51:00.043109 2219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 13:51:00.044436 2219 hybrid_clock.cc:648] HybridClock initialized: now 1781877060044367 us; error 71 us; skew 500 ppm
I20260619 13:51:00.044829 2219 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 13:51:00.047266 2219 webserver.cc:533] Webserver started at http://127.0.105.125:36357/ using document root <none> and password file <none>
I20260619 13:51:00.048120 2219 fs_manager.cc:362] Metadata directory not provided
I20260619 13:51:00.048282 2219 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 13:51:00.054119 2219 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260619 13:51:00.057185 2237 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 13:51:00.058696 2219 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 13:51:00.058913 2219 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data,/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/wal
uuid: "fe5c828398bf4cd592f4a0b084a304b7"
format_stamp: "Formatted at 2026-06-19 13:50:40 on dist-test-slave-7hnr"
I20260619 13:51:00.059744 2219 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 13:51:00.091212 2219 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260619 13:51:00.092155 2219 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 13:51:00.092482 2219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 13:51:00.115126 2219 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.125:37003
I20260619 13:51:00.115128 2288 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.125:37003 every 8 connection(s)
I20260619 13:51:00.116935 2219 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data/info.pb
I20260619 13:51:00.124738 2289 sys_catalog.cc:263] Verifying existing consensus state
I20260619 13:51:00.126750 421 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu as pid 2219
I20260619 13:51:00.129738 2289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: Bootstrap starting.
I20260619 13:51:00.148850 2289 log.cc:826] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: Log is configured to *not* fsync() on all Append() calls
I20260619 13:51:00.181205 2289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: Bootstrap replayed 1/1 log segments. Stats: ops{read=40 overwritten=0 applied=40 ignored=0} inserts{seen=27 ignored=0} mutations{seen=27 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 13:51:00.182000 2289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: Bootstrap complete.
I20260619 13:51:00.187623 2289 raft_consensus.cc:359] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:00.188359 2289 raft_consensus.cc:740] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe5c828398bf4cd592f4a0b084a304b7, State: Initialized, Role: FOLLOWER
I20260619 13:51:00.189122 2289 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 40, Last appended: 4.40, Last appended by leader: 40, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:00.190066 2294 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:51:00.190323 2294 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 13:51:00.191184 2289 sys_catalog.cc:565] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 13:51:00.202219 2219 master_runner.cc:187] Error getting master registration for 127.0.105.126:34929: Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111),
I20260619 13:51:00.208292 2219 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:51:00.210821 2308 catalog_manager.cc:1294] Loaded cluster ID: 83fe01e7c5804ae9b7b2307f12c08ec9
I20260619 13:51:00.211014 2308 catalog_manager.cc:1587] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: loading cluster ID for follower catalog manager: success
I20260619 13:51:00.215003 2308 catalog_manager.cc:1609] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: acquiring CA information for follower catalog manager: success
I20260619 13:51:00.218220 2308 catalog_manager.cc:1637] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 13:51:00.336262 1252 heartbeater.cc:344] Connected to a master server at 127.0.105.125:37003
I20260619 13:51:00.336527 1252 heartbeater.cc:499] Master 127.0.105.125:37003 was elected leader, sending a full tablet report...
I20260619 13:51:00.343075 1390 heartbeater.cc:344] Connected to a master server at 127.0.105.125:37003
I20260619 13:51:00.343331 1390 heartbeater.cc:499] Master 127.0.105.125:37003 was elected leader, sending a full tablet report...
I20260619 13:51:00.344547 2254 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "94599283b9334819b3bbe25509b7cd16" instance_seqno: 1781877042768620) as {username='slave'} at 127.0.105.66:47555; Asking this server to re-register.
I20260619 13:51:00.345726 1252 heartbeater.cc:461] Registering TS with master...
I20260619 13:51:00.345813 2253 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" instance_seqno: 1781877043287674) as {username='slave'} at 127.0.105.67:59413; Asking this server to re-register.
I20260619 13:51:00.346750 1390 heartbeater.cc:461] Registering TS with master...
I20260619 13:51:00.347790 2253 ts_manager.cc:194] Registered new tserver with Master: 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481)
I20260619 13:51:00.348356 2254 ts_manager.cc:194] Registered new tserver with Master: d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
I20260619 13:51:00.472466 1115 heartbeater.cc:344] Connected to a master server at 127.0.105.125:37003
I20260619 13:51:00.474174 2254 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" instance_seqno: 1781877042220212) as {username='slave'} at 127.0.105.65:38605; Asking this server to re-register.
I20260619 13:51:00.474834 1115 heartbeater.cc:461] Registering TS with master...
I20260619 13:51:00.476209 2254 ts_manager.cc:194] Registered new tserver with Master: 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865)
I20260619 13:51:00.567663 2294 raft_consensus.cc:493] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:00.567981 2294 raft_consensus.cc:515] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:00.569988 2294 leader_election.cc:290] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:51:00.571148 2240 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
W20260619 13:51:00.583483 2240 leader_election.cc:336] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
I20260619 13:51:00.589809 2121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fe5c828398bf4cd592f4a0b084a304b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 40 } } ignore_live_leader: false dest_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" is_pre_election: true
I20260619 13:51:00.590292 2121 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe5c828398bf4cd592f4a0b084a304b7 in term 4.
I20260619 13:51:00.591069 2238 leader_election.cc:304] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7; no voters: 7adca601777549878be161a6116e53b6
I20260619 13:51:00.591514 2294 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260619 13:51:00.591679 2294 raft_consensus.cc:493] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 13:51:00.591804 2294 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 4 FOLLOWER]: Advancing to term 5
I20260619 13:51:00.596644 2294 raft_consensus.cc:515] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:00.597406 2294 leader_election.cc:290] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 5 election: Requested vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
I20260619 13:51:00.598140 2121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fe5c828398bf4cd592f4a0b084a304b7" candidate_term: 5 candidate_status { last_received { term: 4 index: 40 } } ignore_live_leader: false dest_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6"
I20260619 13:51:00.598378 2121 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 4 FOLLOWER]: Advancing to term 5
W20260619 13:51:00.599005 2240 leader_election.cc:336] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
I20260619 13:51:00.602382 2121 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe5c828398bf4cd592f4a0b084a304b7 in term 5.
I20260619 13:51:00.602921 2238 leader_election.cc:304] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7; no voters: 7adca601777549878be161a6116e53b6
I20260619 13:51:00.603320 2294 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 5 FOLLOWER]: Leader election won for term 5
I20260619 13:51:00.603865 2294 raft_consensus.cc:697] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 5 LEADER]: Becoming Leader. State: Replica: fe5c828398bf4cd592f4a0b084a304b7, State: Running, Role: LEADER
I20260619 13:51:00.604434 2294 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 40, Committed index: 40, Last appended: 4.40, Last appended by leader: 40, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:00.607326 2321 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe5c828398bf4cd592f4a0b084a304b7. Latest consensus state: current_term: 5 leader_uuid: "fe5c828398bf4cd592f4a0b084a304b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:51:00.607573 2321 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: This master's current role is: LEADER
I20260619 13:51:00.608156 2323 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260619 13:51:00.610874 2323 catalog_manager.cc:679] Loaded metadata for table default.table_1623c8da7f1e42958362607cf3bed6f0 [id=2d3dc93800df4ce7bcaa51ca2d5172eb]
I20260619 13:51:00.611335 2323 catalog_manager.cc:679] Loaded metadata for table default.table_06260aeaf35a4709a2f2596a0268c737 [id=2f052b286bee49df9c7ae8cd8ecfd90b]
I20260619 13:51:00.611683 2323 catalog_manager.cc:679] Loaded metadata for table default.table_2138876d1fe74e81bfc560e2fb592a0e [id=57c8bf0937b84407ace807934df053c4]
I20260619 13:51:00.612146 2323 catalog_manager.cc:679] Loaded metadata for table default.table_08f0dacfa3d348c9ab0e8387f52e681a [id=7774d59813b44a19864817d47194e724]
I20260619 13:51:00.612601 2323 catalog_manager.cc:679] Loaded metadata for table default.table_71421a29531045198619e2e3d9383268 [id=8385a644150b489d9d4f61e2338d081e]
I20260619 13:51:00.613073 2323 catalog_manager.cc:679] Loaded metadata for table default.table_c1ef2fe395ec45c98ee34472a137d486 [id=9aea7bf089c54100afe5510f3b4ec4ae]
I20260619 13:51:00.613409 2323 catalog_manager.cc:679] Loaded metadata for table default.table_75fff73b19164084879700104d9a214c [id=c250a119cf6642b2ad489636485fceac]
I20260619 13:51:00.613770 2323 catalog_manager.cc:679] Loaded metadata for table default.table_6a76b7745ccc406facfc1fc1021b24d9 [id=d0fb54a9a55b4a3b83f7c809ef7d24ea]
I20260619 13:51:00.614106 2323 catalog_manager.cc:679] Loaded metadata for table default.table_8ba4a12b36bd4159a70fe23f31c1e862 [id=e009fdd5a6e2488f9f7bfa3ed6005316]
I20260619 13:51:00.616372 2323 tablet_loader.cc:96] loaded metadata for tablet 99b7f1f73b6449698c36f420002318f6 (table default.table_c1ef2fe395ec45c98ee34472a137d486 [id=9aea7bf089c54100afe5510f3b4ec4ae])
I20260619 13:51:00.616711 2323 tablet_loader.cc:96] loaded metadata for tablet afd1f4707bec4f61b6001eb88426f985 (table default.table_06260aeaf35a4709a2f2596a0268c737 [id=2f052b286bee49df9c7ae8cd8ecfd90b])
I20260619 13:51:00.617029 2323 tablet_loader.cc:96] loaded metadata for tablet b1cf3f5226e7408d8eadb8d0fb670d7b (table default.table_6a76b7745ccc406facfc1fc1021b24d9 [id=d0fb54a9a55b4a3b83f7c809ef7d24ea])
I20260619 13:51:00.617321 2323 tablet_loader.cc:96] loaded metadata for tablet bf536238326544e7ba59cc441da29696 (table default.table_08f0dacfa3d348c9ab0e8387f52e681a [id=7774d59813b44a19864817d47194e724])
I20260619 13:51:00.617687 2323 tablet_loader.cc:96] loaded metadata for tablet c72a70b85f464558a625e293380f610b (table default.table_8ba4a12b36bd4159a70fe23f31c1e862 [id=e009fdd5a6e2488f9f7bfa3ed6005316])
I20260619 13:51:00.618160 2323 tablet_loader.cc:96] loaded metadata for tablet d66b1eaa29454bb3bc8e2c493d01cb43 (table default.table_1623c8da7f1e42958362607cf3bed6f0 [id=2d3dc93800df4ce7bcaa51ca2d5172eb])
I20260619 13:51:00.618462 2323 tablet_loader.cc:96] loaded metadata for tablet d7f76b3a50b24ef380870ccd67510d57 (table default.table_71421a29531045198619e2e3d9383268 [id=8385a644150b489d9d4f61e2338d081e])
I20260619 13:51:00.618753 2323 tablet_loader.cc:96] loaded metadata for tablet da2d71631f364b6e86a17e113d7e8960 (table default.table_2138876d1fe74e81bfc560e2fb592a0e [id=57c8bf0937b84407ace807934df053c4])
I20260619 13:51:00.619050 2323 tablet_loader.cc:96] loaded metadata for tablet e637f2b405c445a1afee9cd9c9db8d08 (table default.table_75fff73b19164084879700104d9a214c [id=c250a119cf6642b2ad489636485fceac])
I20260619 13:51:00.619474 2323 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260619 13:51:00.620582 2323 catalog_manager.cc:1294] Loaded cluster ID: 83fe01e7c5804ae9b7b2307f12c08ec9
I20260619 13:51:00.620688 2323 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260619 13:51:00.622018 2323 catalog_manager.cc:1539] Loading token signing keys...
I20260619 13:51:00.622886 2323 catalog_manager.cc:6080] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: Loaded TSK: 0
I20260619 13:51:00.623764 2323 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260619 13:51:00.624614 2323 catalog_manager.cc:1562] Loading latest processed Hive Metastore notification log event ID...
I20260619 13:51:00.625424 2323 catalog_manager.cc:5918] Last processed Hive Metastore notification event ID: -1
I20260619 13:51:00.742885 2253 master_service.cc:960] ReplaceTablet: received request to replace tablet c8d8f0fa96f04d2b9dd9e4a3e7c97041 from {username='slave'} at 127.0.0.1:48430
I20260619 13:51:00.742818 2254 master_service.cc:960] ReplaceTablet: received request to replace tablet c72a70b85f464558a625e293380f610b from {username='slave'} at 127.0.0.1:48430
I20260619 13:51:00.744000 2249 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48430:
name: "default.Table_80df4ccadd5348ba8e554c5123f21f78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:51:00.744115 2246 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48430:
name: "default.Table_a99ce2d337bd4e478e3c1723e2a85c8a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:51:00.744875 2247 master_service.cc:960] ReplaceTablet: received request to replace tablet 81c901680eb84fe7ae5957ca045f2d69 from {username='slave'} at 127.0.0.1:48430
I20260619 13:51:00.745115 2250 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48430:
table { table_name: "default.Table_c1ef2fe395ec45c98ee34472a137d486" } new_table_name: "default.Table_de9cc9659e5542e482897905c4fd7381" modify_external_catalogs: true
I20260619 13:51:00.745685 2247 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48430:
table { table_name: "default.Table_1623c8da7f1e42958362607cf3bed6f0" } new_table_name: "default.Table_5fdb6be1506543aab7b2548398b26c61" modify_external_catalogs: true
I20260619 13:51:00.745824 2251 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48430:
name: "default.Table_b08623aacbde40ed8d75707540765476"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:51:00.746124 2248 master_service.cc:960] ReplaceTablet: received request to replace tablet c8d8f0fa96f04d2b9dd9e4a3e7c97041 from {username='slave'} at 127.0.0.1:48430
I20260619 13:51:00.746246 2253 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48430:
table { table_name: "default.Table_75fff73b19164084879700104d9a214c" } new_table_name: "default.Table_f424e0ef22ac4d4492d2ca6a9b24d277" modify_external_catalogs: true
I20260619 13:51:00.746407 2252 master_service.cc:960] ReplaceTablet: received request to replace tablet 0fd56579c7a44155a0090e2720566a58 from {username='slave'} at 127.0.0.1:48430
I20260619 13:51:00.746894 2245 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48430:
table { table_name: "default.Table_06260aeaf35a4709a2f2596a0268c737" } modify_external_catalogs: true
I20260619 13:51:00.746807 2248 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48430:
name: "default.Table_93c2826cde41498d8b9d82f106824c41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:51:00.747138 2245 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48430:
table { table_name: "default.Table_06260aeaf35a4709a2f2596a0268c737" } modify_external_catalogs: true
I20260619 13:51:00.747090 2252 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48430:
name: "default.Table_8c43993fce7349e49137eb5cb7ed4fc7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:51:00.751410 2121 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 5 FOLLOWER]: Refusing update from remote peer fe5c828398bf4cd592f4a0b084a304b7: Log matching property violated. Preceding OpId in replica: term: 4 index: 40. Preceding OpId from leader: term: 5 index: 42. (index mismatch)
I20260619 13:51:00.752435 2321 consensus_queue.cc:1048] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 41, Last known committed idx: 40, Time since last communication: 0.000s
W20260619 13:51:00.754050 2240 consensus_peers.cc:597] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 -> Peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Couldn't send request to peer 7adca601777549878be161a6116e53b6. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
F20260619 13:51:00.754856 2307 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 1, previous 1; dumping first 2 out of 10 received events: NotificationEvent(eventId=1, eventTime=1781877043, eventType=CREATE_TABLE, dbName=default, tableName=table_2138876d1fe74e81bfc560e2fb592a0e, message={"server":"","servicePrincipal":"","db":"default","table":"table_2138876d1fe74e81bfc560e2fb592a0e","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_2138876d1fe74e81bfc560e2fb592a0e\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1781877043},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/warehouse/table_2138876d1fe74e81bfc560e2fb592a0e\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_2138876d1fe74e81bfc560e2fb592a0e\",\"kudu.table_id\":\"57c8bf0937b84407ace807934df053c4\",\"transient_lastDdlTime\":\"1781877043\",\"comment\":\"\",\"kudu.master_addresses\":\"127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"83fe01e7c5804ae9b7b2307f12c08ec9\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1781877043,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=1, eventTime=1781877043, eventType=CREATE_TABLE, dbName=default, tableName=table_c52ddc84a5e24c718eba7aab2234f558, message={"server":"","servicePrincipal":"","db":"default","table":"table_c52ddc84a5e24c718eba7aab2234f558","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_c52ddc84a5e24c718eba7aab2234f558\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1781877043},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/warehouse/table_c52ddc84a5e24c718eba7aab2234f558\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_c52ddc84a5e24c718eba7aab2234f558\",\"kudu.table_id\":\"b3b37daaec8c448a98386eb208b2cd04\",\"transient_lastDdlTime\":\"1781877043\",\"comment\":\"\",\"kudu.master_addresses\":\"127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"83fe01e7c5804ae9b7b2307f12c08ec9\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1781877043,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7fd349339dcd google::LogMessage::Fail() at ??:0
@ 0x7fd34933db93 google::LogMessage::SendToLog() at ??:0
I20260619 13:51:00.759608 2325 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe5c828398bf4cd592f4a0b084a304b7. Latest consensus state: current_term: 5 leader_uuid: "fe5c828398bf4cd592f4a0b084a304b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:51:00.759922 2325 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7fd3493397cc google::LogMessage::Flush() at ??:0
@ 0x7fd349339a11 google::LogMessage::~LogMessage() at ??:0
I20260619 13:51:00.767256 2325 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "fe5c828398bf4cd592f4a0b084a304b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:51:00.767524 2325 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7fd35ff34394 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260619 13:51:00.770684 2254 catalog_manager.cc:5983] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: Sending DeleteTablet for 3 replicas of tablet c72a70b85f464558a625e293380f610b
I20260619 13:51:00.771136 2321 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "fe5c828398bf4cd592f4a0b084a304b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:51:00.771446 2321 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: This master's current role is: LEADER
I20260619 13:51:00.773046 2254 catalog_manager.cc:6784] ReplaceTablet: tablet c72a70b85f464558a625e293380f610b deleted and replaced by tablet 9260801313d44149bbd4d1246691e7df
I20260619 13:51:00.773491 2254 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48430:
name: "default.Table_387aecac34f04c43a7bf701eff348112"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:51:00.791771 1322 tablet_service.cc:1558] Processing DeleteTablet for tablet c72a70b85f464558a625e293380f610b with delete_type TABLET_DATA_DELETED (replaced by tablet 9260801313d44149bbd4d1246691e7df) from {username='slave'} at 127.0.0.1:40338
I20260619 13:51:00.792117 1321 tablet_service.cc:1511] Processing CreateTablet for tablet 9260801313d44149bbd4d1246691e7df (DEFAULT_TABLE table=default.table_8ba4a12b36bd4159a70fe23f31c1e862 [id=e009fdd5a6e2488f9f7bfa3ed6005316]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:51:00.792584 1321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9260801313d44149bbd4d1246691e7df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:51:00.793641 1046 tablet_service.cc:1558] Processing DeleteTablet for tablet c72a70b85f464558a625e293380f610b with delete_type TABLET_DATA_DELETED (replaced by tablet 9260801313d44149bbd4d1246691e7df) from {username='slave'} at 127.0.0.1:55604
I20260619 13:51:00.795639 1048 tablet_service.cc:1511] Processing CreateTablet for tablet 9260801313d44149bbd4d1246691e7df (DEFAULT_TABLE table=default.table_8ba4a12b36bd4159a70fe23f31c1e862 [id=e009fdd5a6e2488f9f7bfa3ed6005316]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:51:00.796217 1048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9260801313d44149bbd4d1246691e7df. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7fd35ff32c41 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7fd35ff3a8bc kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260619 13:51:00.817376 2341 tablet_bootstrap.cc:492] T 9260801313d44149bbd4d1246691e7df P 380c26fd105f454cbe8ef6b87e35f41f: Bootstrap starting.
@ 0x7fd35ff3a739 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa681d std::function<>::operator()() at ??:?
I20260619 13:51:00.827443 2339 tablet_replica.cc:333] T c72a70b85f464558a625e293380f610b P 380c26fd105f454cbe8ef6b87e35f41f: stopping tablet replica
I20260619 13:51:00.827754 2339 raft_consensus.cc:2243] T c72a70b85f464558a625e293380f610b P 380c26fd105f454cbe8ef6b87e35f41f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 13:51:00.828056 2339 raft_consensus.cc:2272] T c72a70b85f464558a625e293380f610b P 380c26fd105f454cbe8ef6b87e35f41f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 13:51:00.828874 2339 ts_tablet_manager.cc:1916] T c72a70b85f464558a625e293380f610b P 380c26fd105f454cbe8ef6b87e35f41f: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7fd34c060f49 kudu::Thread::SuperviseThread() at ??:0
I20260619 13:51:00.832621 1184 tablet_service.cc:1558] Processing DeleteTablet for tablet c72a70b85f464558a625e293380f610b with delete_type TABLET_DATA_DELETED (replaced by tablet 9260801313d44149bbd4d1246691e7df) from {username='slave'} at 127.0.0.1:60396
I20260619 13:51:00.833426 2338 tablet_replica.cc:333] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9: stopping tablet replica
I20260619 13:51:00.833400 1185 tablet_service.cc:1511] Processing CreateTablet for tablet 9260801313d44149bbd4d1246691e7df (DEFAULT_TABLE table=default.table_8ba4a12b36bd4159a70fe23f31c1e862 [id=e009fdd5a6e2488f9f7bfa3ed6005316]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 13:51:00.833666 2338 raft_consensus.cc:2243] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9 [term 1 LEADER]: Raft consensus shutting down.
I20260619 13:51:00.833995 1185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9260801313d44149bbd4d1246691e7df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 13:51:00.834476 2342 tablet_replica.cc:333] T c72a70b85f464558a625e293380f610b P 94599283b9334819b3bbe25509b7cd16: stopping tablet replica
I20260619 13:51:00.834682 2342 raft_consensus.cc:2243] T c72a70b85f464558a625e293380f610b P 94599283b9334819b3bbe25509b7cd16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 13:51:00.835079 2342 raft_consensus.cc:2272] T c72a70b85f464558a625e293380f610b P 94599283b9334819b3bbe25509b7cd16 [term 1 FOLLOWER]: Raft consensus is shut down!
@ 0x7fd34f72a6db start_thread at ??:0
I20260619 13:51:00.835917 2342 ts_tablet_manager.cc:1916] T c72a70b85f464558a625e293380f610b P 94599283b9334819b3bbe25509b7cd16: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7fd3481e861f clone at ??:0
I20260619 13:51:00.837771 2338 raft_consensus.cc:2272] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 13:51:00.838416 2338 ts_tablet_manager.cc:1916] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 13:51:00.838572 2341 tablet_bootstrap.cc:654] T 9260801313d44149bbd4d1246691e7df P 380c26fd105f454cbe8ef6b87e35f41f: Neither blocks nor log segments found. Creating new log.
I20260619 13:51:00.843781 2346 tablet_bootstrap.cc:492] T 9260801313d44149bbd4d1246691e7df P 94599283b9334819b3bbe25509b7cd16: Bootstrap starting.
I20260619 13:51:00.847798 2342 ts_tablet_manager.cc:1929] T c72a70b85f464558a625e293380f610b P 94599283b9334819b3bbe25509b7cd16: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 13:51:00.847973 2342 log.cc:1199] T c72a70b85f464558a625e293380f610b P 94599283b9334819b3bbe25509b7cd16: Deleting WAL directory at /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-1/wal/wals/c72a70b85f464558a625e293380f610b
I20260619 13:51:00.847982 2340 tablet_bootstrap.cc:492] T 9260801313d44149bbd4d1246691e7df P d54f30d62f034b35a8e73ff525ba43d9: Bootstrap starting.
I20260619 13:51:00.848428 2342 ts_tablet_manager.cc:1950] T c72a70b85f464558a625e293380f610b P 94599283b9334819b3bbe25509b7cd16: Deleting consensus metadata
I20260619 13:51:00.849026 2346 tablet_bootstrap.cc:654] T 9260801313d44149bbd4d1246691e7df P 94599283b9334819b3bbe25509b7cd16: Neither blocks nor log segments found. Creating new log.
I20260619 13:51:00.849906 2340 tablet_bootstrap.cc:654] T 9260801313d44149bbd4d1246691e7df P d54f30d62f034b35a8e73ff525ba43d9: Neither blocks nor log segments found. Creating new log.
I20260619 13:51:00.852824 2339 ts_tablet_manager.cc:1929] T c72a70b85f464558a625e293380f610b P 380c26fd105f454cbe8ef6b87e35f41f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 13:51:00.852883 2341 tablet_bootstrap.cc:492] T 9260801313d44149bbd4d1246691e7df P 380c26fd105f454cbe8ef6b87e35f41f: No bootstrap required, opened a new log
I20260619 13:51:00.852933 2339 log.cc:1199] T c72a70b85f464558a625e293380f610b P 380c26fd105f454cbe8ef6b87e35f41f: Deleting WAL directory at /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-0/wal/wals/c72a70b85f464558a625e293380f610b
I20260619 13:51:00.853068 2341 ts_tablet_manager.cc:1403] T 9260801313d44149bbd4d1246691e7df P 380c26fd105f454cbe8ef6b87e35f41f: Time spent bootstrapping tablet: real 0.036s user 0.007s sys 0.000s
I20260619 13:51:00.853276 2339 ts_tablet_manager.cc:1950] T c72a70b85f464558a625e293380f610b P 380c26fd105f454cbe8ef6b87e35f41f: Deleting consensus metadata
I20260619 13:51:00.854069 2341 raft_consensus.cc:359] T 9260801313d44149bbd4d1246691e7df P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } }
I20260619 13:51:00.854296 2341 raft_consensus.cc:385] T 9260801313d44149bbd4d1246691e7df P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:51:00.854389 2341 raft_consensus.cc:740] T 9260801313d44149bbd4d1246691e7df P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 380c26fd105f454cbe8ef6b87e35f41f, State: Initialized, Role: FOLLOWER
I20260619 13:51:00.854630 2341 consensus_queue.cc:260] T 9260801313d44149bbd4d1246691e7df P 380c26fd105f454cbe8ef6b87e35f41f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } }
I20260619 13:51:00.855170 2341 ts_tablet_manager.cc:1434] T 9260801313d44149bbd4d1246691e7df P 380c26fd105f454cbe8ef6b87e35f41f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260619 13:51:00.855732 2338 ts_tablet_manager.cc:1929] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260619 13:51:00.855863 2338 log.cc:1199] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9: Deleting WAL directory at /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/ts-2/wal/wals/c72a70b85f464558a625e293380f610b
I20260619 13:51:00.856302 2338 ts_tablet_manager.cc:1950] T c72a70b85f464558a625e293380f610b P d54f30d62f034b35a8e73ff525ba43d9: Deleting consensus metadata
I20260619 13:51:00.858304 2346 tablet_bootstrap.cc:492] T 9260801313d44149bbd4d1246691e7df P 94599283b9334819b3bbe25509b7cd16: No bootstrap required, opened a new log
I20260619 13:51:00.858457 2346 ts_tablet_manager.cc:1403] T 9260801313d44149bbd4d1246691e7df P 94599283b9334819b3bbe25509b7cd16: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.003s
I20260619 13:51:00.859335 2340 tablet_bootstrap.cc:492] T 9260801313d44149bbd4d1246691e7df P d54f30d62f034b35a8e73ff525ba43d9: No bootstrap required, opened a new log
I20260619 13:51:00.859488 2340 ts_tablet_manager.cc:1403] T 9260801313d44149bbd4d1246691e7df P d54f30d62f034b35a8e73ff525ba43d9: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260619 13:51:00.860535 2340 raft_consensus.cc:359] T 9260801313d44149bbd4d1246691e7df P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } }
I20260619 13:51:00.860706 2340 raft_consensus.cc:385] T 9260801313d44149bbd4d1246691e7df P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:51:00.860502 2346 raft_consensus.cc:359] T 9260801313d44149bbd4d1246691e7df P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } }
I20260619 13:51:00.860795 2346 raft_consensus.cc:385] T 9260801313d44149bbd4d1246691e7df P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 13:51:00.860791 2340 raft_consensus.cc:740] T 9260801313d44149bbd4d1246691e7df P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54f30d62f034b35a8e73ff525ba43d9, State: Initialized, Role: FOLLOWER
I20260619 13:51:00.860875 2346 raft_consensus.cc:740] T 9260801313d44149bbd4d1246691e7df P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94599283b9334819b3bbe25509b7cd16, State: Initialized, Role: FOLLOWER
I20260619 13:51:00.861088 2340 consensus_queue.cc:260] T 9260801313d44149bbd4d1246691e7df P d54f30d62f034b35a8e73ff525ba43d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } }
I20260619 13:51:00.861155 2346 consensus_queue.cc:260] T 9260801313d44149bbd4d1246691e7df P 94599283b9334819b3bbe25509b7cd16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } }
I20260619 13:51:00.861665 2346 ts_tablet_manager.cc:1434] T 9260801313d44149bbd4d1246691e7df P 94599283b9334819b3bbe25509b7cd16: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260619 13:51:00.862470 2340 ts_tablet_manager.cc:1434] T 9260801313d44149bbd4d1246691e7df P d54f30d62f034b35a8e73ff525ba43d9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 13:51:00.972944 2221 raft_consensus.cc:493] T 9260801313d44149bbd4d1246691e7df P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:00.973182 2221 raft_consensus.cc:515] T 9260801313d44149bbd4d1246691e7df P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } }
I20260619 13:51:00.974402 2221 leader_election.cc:290] T 9260801313d44149bbd4d1246691e7df P 94599283b9334819b3bbe25509b7cd16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
I20260619 13:51:00.974951 1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9260801313d44149bbd4d1246691e7df" candidate_uuid: "94599283b9334819b3bbe25509b7cd16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "380c26fd105f454cbe8ef6b87e35f41f" is_pre_election: true
I20260619 13:51:00.974988 1342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9260801313d44149bbd4d1246691e7df" candidate_uuid: "94599283b9334819b3bbe25509b7cd16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f30d62f034b35a8e73ff525ba43d9" is_pre_election: true
I20260619 13:51:00.975217 1068 raft_consensus.cc:2468] T 9260801313d44149bbd4d1246691e7df P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94599283b9334819b3bbe25509b7cd16 in term 0.
I20260619 13:51:00.975271 1342 raft_consensus.cc:2468] T 9260801313d44149bbd4d1246691e7df P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94599283b9334819b3bbe25509b7cd16 in term 0.
I20260619 13:51:00.975805 1141 leader_election.cc:304] T 9260801313d44149bbd4d1246691e7df P 94599283b9334819b3bbe25509b7cd16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9; no voters:
I20260619 13:51:00.976176 2221 raft_consensus.cc:2804] T 9260801313d44149bbd4d1246691e7df P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 13:51:00.976300 2221 raft_consensus.cc:493] T 9260801313d44149bbd4d1246691e7df P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 13:51:00.976393 2221 raft_consensus.cc:3060] T 9260801313d44149bbd4d1246691e7df P 94599283b9334819b3bbe25509b7cd16 [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:51:00.979293 2221 raft_consensus.cc:515] T 9260801313d44149bbd4d1246691e7df P 94599283b9334819b3bbe25509b7cd16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } }
I20260619 13:51:00.980029 2221 leader_election.cc:290] T 9260801313d44149bbd4d1246691e7df P 94599283b9334819b3bbe25509b7cd16 [CANDIDATE]: Term 1 election: Requested vote from peers 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
I20260619 13:51:00.980541 1342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9260801313d44149bbd4d1246691e7df" candidate_uuid: "94599283b9334819b3bbe25509b7cd16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54f30d62f034b35a8e73ff525ba43d9"
I20260619 13:51:00.980579 1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9260801313d44149bbd4d1246691e7df" candidate_uuid: "94599283b9334819b3bbe25509b7cd16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "380c26fd105f454cbe8ef6b87e35f41f"
I20260619 13:51:00.980783 1342 raft_consensus.cc:3060] T 9260801313d44149bbd4d1246691e7df P d54f30d62f034b35a8e73ff525ba43d9 [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:51:00.980811 1068 raft_consensus.cc:3060] T 9260801313d44149bbd4d1246691e7df P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Advancing to term 1
I20260619 13:51:00.982960 1342 raft_consensus.cc:2468] T 9260801313d44149bbd4d1246691e7df P d54f30d62f034b35a8e73ff525ba43d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94599283b9334819b3bbe25509b7cd16 in term 1.
I20260619 13:51:00.983464 1141 leader_election.cc:304] T 9260801313d44149bbd4d1246691e7df P 94599283b9334819b3bbe25509b7cd16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9; no voters:
I20260619 13:51:00.983624 1068 raft_consensus.cc:2468] T 9260801313d44149bbd4d1246691e7df P 380c26fd105f454cbe8ef6b87e35f41f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94599283b9334819b3bbe25509b7cd16 in term 1.
I20260619 13:51:00.983940 2221 raft_consensus.cc:2804] T 9260801313d44149bbd4d1246691e7df P 94599283b9334819b3bbe25509b7cd16 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 13:51:00.985059 2221 raft_consensus.cc:697] T 9260801313d44149bbd4d1246691e7df P 94599283b9334819b3bbe25509b7cd16 [term 1 LEADER]: Becoming Leader. State: Replica: 94599283b9334819b3bbe25509b7cd16, State: Running, Role: LEADER
I20260619 13:51:00.985706 2221 consensus_queue.cc:237] T 9260801313d44149bbd4d1246691e7df P 94599283b9334819b3bbe25509b7cd16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } }
W20260619 13:51:01.041538 1002 connection.cc:573] server connection from 127.0.0.1:55604 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 13:51:01.041545 1278 connection.cc:573] server connection from 127.0.0.1:40338 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 13:51:01.041555 1141 connection.cc:573] server connection from 127.0.0.1:60396 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 13:51:01.041965 1003 connection.cc:573] client connection to 127.0.105.125:37003 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 13:51:01.042029 1278 connection.cc:573] client connection to 127.0.105.125:37003 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 13:51:01.042276 1140 connection.cc:573] client connection to 127.0.105.125:37003 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 13:51:01.042908 1397 connection.cc:573] client connection to 127.0.105.125:37003 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 13:51:01.044008 1397 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.105.125:37003)
W20260619 13:51:01.044687 1397 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.105.125:37003)
W20260619 13:51:01.044896 1397 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.105.125:37003)
W20260619 13:51:01.045626 1397 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.105.125:37003)
I20260619 13:51:01.290946 2360 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe5c828398bf4cd592f4a0b084a304b7)
I20260619 13:51:01.291198 2360 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:01.291841 2360 leader_election.cc:290] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003)
W20260619 13:51:01.294062 2096 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
W20260619 13:51:01.294337 2096 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:51:01.294450 2096 leader_election.cc:304] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6184e94a3ec241bfa8d2e34ea579f8a6; no voters: 7adca601777549878be161a6116e53b6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:51:01.294816 2360 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260619 13:51:01.419031 2071 master_runner.cc:187] Error getting master registration for 127.0.105.126:34929: Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111),
I20260619 13:51:01.419279 2071 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:51:01.882673 2221 consensus_queue.cc:1048] T 9260801313d44149bbd4d1246691e7df P 94599283b9334819b3bbe25509b7cd16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 13:51:01.889544 2369 consensus_queue.cc:1048] T 9260801313d44149bbd4d1246691e7df P 94599283b9334819b3bbe25509b7cd16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 13:51:02.009027 2376 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe5c828398bf4cd592f4a0b084a304b7)
I20260619 13:51:02.009220 2376 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:02.009955 2376 leader_election.cc:290] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003)
W20260619 13:51:02.011149 2096 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20260619 13:51:02.012542 2096 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
W20260619 13:51:02.012777 2096 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:51:02.012907 2096 leader_election.cc:304] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6184e94a3ec241bfa8d2e34ea579f8a6; no voters: 7adca601777549878be161a6116e53b6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:51:02.013293 2376 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260619 13:51:02.299259 421 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu pid 2071
I20260619 13:51:02.307438 2141 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 13:51:02.425369 421 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu with pid 2071
W20260619 13:51:02.448029 1276 connection.cc:573] client connection to 127.0.105.124:40279 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260619 13:51:02.669418 2366 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:02.669689 2366 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:51:02.670535 2366 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:51:02.671422 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:51:02.671607 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:51:02.671748 1002 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:51:02.672087 2366 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 13:51:03.120476 421 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
/tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.124:40279
--webserver_interface=127.0.105.124
--webserver_port=45257
--builtin_ntp_servers=127.0.105.84:41509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--hive_metastore_uris=thrift://127.0.0.1:39807
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260619 13:51:03.616714 2396 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 13:51:03.617255 2396 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 13:51:03.617419 2396 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260619 13:51:03.631717 2396 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 13:51:03.631847 2396 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260619 13:51:03.631919 2396 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 13:51:03.631983 2396 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260619 13:51:03.645673 2396 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.84:41509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:39807
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.124:40279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.105.124
--webserver_port=45257
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 19 Jun 2026 13:43:23 UTC on bdcb31816ec0
build id 12470
ASAN enabled
I20260619 13:51:03.647320 2396 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 13:51:03.649917 2396 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260619 13:51:03.658895 2409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:51:03.659029 2412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:51:03.658895 2410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 13:51:03.660737 2396 server_base.cc:1061] running on GCE node
I20260619 13:51:03.661585 2396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 13:51:03.663287 2396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 13:51:03.664548 2396 hybrid_clock.cc:648] HybridClock initialized: now 1781877063664504 us; error 60 us; skew 500 ppm
I20260619 13:51:03.664942 2396 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 13:51:03.667354 2396 webserver.cc:533] Webserver started at http://127.0.105.124:45257/ using document root <none> and password file <none>
I20260619 13:51:03.668190 2396 fs_manager.cc:362] Metadata directory not provided
I20260619 13:51:03.668331 2396 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 13:51:03.674171 2396 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260619 13:51:03.677228 2418 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 13:51:03.678992 2396 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 13:51:03.679229 2396 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data,/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/wal
uuid: "6184e94a3ec241bfa8d2e34ea579f8a6"
format_stamp: "Formatted at 2026-06-19 13:50:41 on dist-test-slave-7hnr"
I20260619 13:51:03.680047 2396 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 13:51:03.728889 2396 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260619 13:51:03.730019 2396 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 13:51:03.730381 2396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 13:51:03.753575 2396 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.124:40279
I20260619 13:51:03.753582 2469 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.124:40279 every 8 connection(s)
I20260619 13:51:03.755486 2396 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-2/data/info.pb
I20260619 13:51:03.762784 2470 sys_catalog.cc:263] Verifying existing consensus state
I20260619 13:51:03.764026 421 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu as pid 2396
I20260619 13:51:03.766908 2470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: Bootstrap starting.
I20260619 13:51:03.782021 2470 log.cc:826] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: Log is configured to *not* fsync() on all Append() calls
I20260619 13:51:03.805285 1250 heartbeater.cc:344] Connected to a master server at 127.0.105.124:40279
I20260619 13:51:03.834789 2470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=43 overwritten=0 applied=43 ignored=0} inserts{seen=28 ignored=0} mutations{seen=29 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 13:51:03.835425 2470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: Bootstrap complete.
I20260619 13:51:03.840781 2470 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:03.841590 2470 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6184e94a3ec241bfa8d2e34ea579f8a6, State: Initialized, Role: FOLLOWER
I20260619 13:51:03.842250 2470 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 43, Last appended: 5.43, Last appended by leader: 43, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:03.843088 2477 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:51:03.843334 2477 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 13:51:03.844188 2470 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 13:51:03.854686 2396 master_runner.cc:187] Error getting master registration for 127.0.105.126:34929: Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111),
I20260619 13:51:03.860510 2396 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:51:03.863873 2491 catalog_manager.cc:1294] Loaded cluster ID: 83fe01e7c5804ae9b7b2307f12c08ec9
I20260619 13:51:03.863996 2491 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: loading cluster ID for follower catalog manager: success
I20260619 13:51:03.868928 2491 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: acquiring CA information for follower catalog manager: success
I20260619 13:51:03.872471 2491 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 13:51:03.879467 1388 heartbeater.cc:344] Connected to a master server at 127.0.105.124:40279
I20260619 13:51:03.882812 2435 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" instance_seqno: 1781877043287674) as {username='slave'} at 127.0.105.67:58009; Asking this server to re-register.
I20260619 13:51:03.884204 1388 heartbeater.cc:461] Registering TS with master...
I20260619 13:51:03.888377 2435 ts_manager.cc:194] Registered new tserver with Master: d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
I20260619 13:51:03.935537 1113 heartbeater.cc:344] Connected to a master server at 127.0.105.124:40279
I20260619 13:51:03.937218 2435 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" instance_seqno: 1781877042220212) as {username='slave'} at 127.0.105.65:42949; Asking this server to re-register.
I20260619 13:51:03.937911 1113 heartbeater.cc:461] Registering TS with master...
I20260619 13:51:03.939601 2435 ts_manager.cc:194] Registered new tserver with Master: 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865)
I20260619 13:51:04.228607 2477 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:04.228967 2477 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:04.231096 2477 leader_election.cc:290] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003)
W20260619 13:51:04.231930 2421 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
W20260619 13:51:04.233747 2421 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
W20260619 13:51:04.234144 2421 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:51:04.234311 2421 leader_election.cc:304] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6184e94a3ec241bfa8d2e34ea579f8a6; no voters: 7adca601777549878be161a6116e53b6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:51:04.234810 2477 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260619 13:51:04.299908 2435 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "94599283b9334819b3bbe25509b7cd16" instance_seqno: 1781877042768620) as {username='slave'} at 127.0.105.66:51501; Asking this server to re-register.
I20260619 13:51:04.300536 1250 heartbeater.cc:461] Registering TS with master...
I20260619 13:51:04.301920 2435 ts_manager.cc:194] Registered new tserver with Master: 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481)
I20260619 13:51:04.939656 2502 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:04.939854 2502 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:04.940567 2502 leader_election.cc:290] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003)
W20260619 13:51:04.942903 2421 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
W20260619 13:51:04.943104 2421 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:51:04.943233 2421 leader_election.cc:304] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6184e94a3ec241bfa8d2e34ea579f8a6; no voters: 7adca601777549878be161a6116e53b6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:51:04.943514 2502 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260619 13:51:05.070698 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 11: this message will repeat every 5th retry.
I20260619 13:51:05.756168 2514 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:05.756383 2514 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:05.757136 2514 leader_election.cc:290] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003)
W20260619 13:51:05.760835 2421 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
W20260619 13:51:05.761103 2421 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:51:05.761225 2421 leader_election.cc:304] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6184e94a3ec241bfa8d2e34ea579f8a6; no voters: 7adca601777549878be161a6116e53b6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:51:05.761523 2514 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260619 13:51:06.674017 2531 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:06.674292 2531 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:06.675052 2531 leader_election.cc:290] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003)
W20260619 13:51:06.678846 2421 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7adca601777549878be161a6116e53b6 (127.0.105.126:34929): Network error: Client connection negotiation failed: client connection to 127.0.105.126:34929: connect: Connection refused (error 111)
W20260619 13:51:06.679100 2421 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:51:06.679235 2421 leader_election.cc:304] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6184e94a3ec241bfa8d2e34ea579f8a6; no voters: 7adca601777549878be161a6116e53b6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:51:06.679527 2531 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260619 13:51:06.945791 421 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
/tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.126:34929
--webserver_interface=127.0.105.126
--webserver_port=45763
--builtin_ntp_servers=127.0.105.84:41509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--hive_metastore_uris=thrift://127.0.0.1:39807
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260619 13:51:07.301235 2541 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 13:51:07.301651 2541 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 13:51:07.301738 2541 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260619 13:51:07.311503 2541 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 13:51:07.311605 2541 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260619 13:51:07.311659 2541 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 13:51:07.311707 2541 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260619 13:51:07.322602 2541 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.84:41509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:39807
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.126:34929
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.105.126
--webserver_port=45763
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 19 Jun 2026 13:43:23 UTC on bdcb31816ec0
build id 12470
ASAN enabled
I20260619 13:51:07.324316 2541 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 13:51:07.326396 2541 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260619 13:51:07.335810 2550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:51:07.335881 2551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:51:07.336552 2553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 13:51:07.336931 2541 server_base.cc:1061] running on GCE node
I20260619 13:51:07.337934 2541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 13:51:07.339419 2541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 13:51:07.340670 2541 hybrid_clock.cc:648] HybridClock initialized: now 1781877067340632 us; error 54 us; skew 500 ppm
I20260619 13:51:07.341039 2541 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 13:51:07.343750 2541 webserver.cc:533] Webserver started at http://127.0.105.126:45763/ using document root <none> and password file <none>
I20260619 13:51:07.344617 2541 fs_manager.cc:362] Metadata directory not provided
I20260619 13:51:07.344775 2541 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 13:51:07.350739 2541 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260619 13:51:07.353816 2559 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 13:51:07.355298 2541 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260619 13:51:07.355516 2541 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/data,/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/wal
uuid: "7adca601777549878be161a6116e53b6"
format_stamp: "Formatted at 2026-06-19 13:50:40 on dist-test-slave-7hnr"
I20260619 13:51:07.356330 2541 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 13:51:07.371419 2541 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260619 13:51:07.372373 2541 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 13:51:07.372699 2541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 13:51:07.394172 2541 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.126:34929
I20260619 13:51:07.394207 2610 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.126:34929 every 8 connection(s)
I20260619 13:51:07.395882 2541 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/data/info.pb
I20260619 13:51:07.396696 421 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu as pid 2541
I20260619 13:51:07.405275 2611 sys_catalog.cc:263] Verifying existing consensus state
I20260619 13:51:07.409204 2611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6: Bootstrap starting.
I20260619 13:51:07.421442 1114 heartbeater.cc:344] Connected to a master server at 127.0.105.126:34929
I20260619 13:51:07.424016 2611 log.cc:826] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6: Log is configured to *not* fsync() on all Append() calls
I20260619 13:51:07.457109 2611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=37 overwritten=0 applied=37 ignored=0} inserts{seen=26 ignored=0} mutations{seen=24 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 13:51:07.457757 2611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6: Bootstrap complete.
I20260619 13:51:07.463255 2611 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:07.463932 2611 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7adca601777549878be161a6116e53b6, State: Initialized, Role: FOLLOWER
I20260619 13:51:07.464674 2611 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 37, Last appended: 3.37, Last appended by leader: 37, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:07.465485 2617 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:51:07.465824 2617 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 13:51:07.466598 2611 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 13:51:07.480134 2631 catalog_manager.cc:1294] Loaded cluster ID: 83fe01e7c5804ae9b7b2307f12c08ec9
I20260619 13:51:07.480406 2631 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6: loading cluster ID for follower catalog manager: success
I20260619 13:51:07.487138 2631 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6: acquiring CA information for follower catalog manager: success
I20260619 13:51:07.489843 2631 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 13:51:07.501737 2541 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:51:07.505306 2541 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:51:07.517030 1389 heartbeater.cc:344] Connected to a master server at 127.0.105.126:34929
I20260619 13:51:07.520156 2576 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" instance_seqno: 1781877043287674) as {username='slave'} at 127.0.105.67:42749; Asking this server to re-register.
I20260619 13:51:07.521063 1389 heartbeater.cc:461] Registering TS with master...
I20260619 13:51:07.523229 2576 ts_manager.cc:194] Registered new tserver with Master: d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
I20260619 13:51:07.791628 2637 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:07.791862 2637 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:07.792666 2637 leader_election.cc:290] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003)
W20260619 13:51:07.802953 2421 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:51:07.802774 2586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 43 } } ignore_live_leader: false dest_uuid: "7adca601777549878be161a6116e53b6" is_pre_election: true
I20260619 13:51:07.803445 2586 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6184e94a3ec241bfa8d2e34ea579f8a6 in term 3.
I20260619 13:51:07.804104 2421 leader_election.cc:304] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6184e94a3ec241bfa8d2e34ea579f8a6, 7adca601777549878be161a6116e53b6; no voters: fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:51:07.804421 2637 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260619 13:51:07.804585 2637 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 13:51:07.804692 2637 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 5 FOLLOWER]: Advancing to term 6
I20260619 13:51:07.810180 2637 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:07.811030 2637 leader_election.cc:290] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 election: Requested vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003)
I20260619 13:51:07.811643 2586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" candidate_term: 6 candidate_status { last_received { term: 5 index: 43 } } ignore_live_leader: false dest_uuid: "7adca601777549878be161a6116e53b6"
I20260619 13:51:07.811888 2586 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 3 FOLLOWER]: Advancing to term 6
W20260619 13:51:07.813113 2421 leader_election.cc:336] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:51:07.817716 2586 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6184e94a3ec241bfa8d2e34ea579f8a6 in term 6.
I20260619 13:51:07.818320 2421 leader_election.cc:304] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6184e94a3ec241bfa8d2e34ea579f8a6, 7adca601777549878be161a6116e53b6; no voters: fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:51:07.818745 1251 heartbeater.cc:344] Connected to a master server at 127.0.105.126:34929
I20260619 13:51:07.818840 2637 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 6 FOLLOWER]: Leader election won for term 6
I20260619 13:51:07.819330 2637 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [term 6 LEADER]: Becoming Leader. State: Replica: 6184e94a3ec241bfa8d2e34ea579f8a6, State: Running, Role: LEADER
I20260619 13:51:07.819902 2637 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 43, Committed index: 43, Last appended: 5.43, Last appended by leader: 43, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:07.821269 2576 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "94599283b9334819b3bbe25509b7cd16" instance_seqno: 1781877042768620) as {username='slave'} at 127.0.105.66:34855; Asking this server to re-register.
I20260619 13:51:07.822105 1251 heartbeater.cc:461] Registering TS with master...
I20260619 13:51:07.823061 2643 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6184e94a3ec241bfa8d2e34ea579f8a6. Latest consensus state: current_term: 6 leader_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:51:07.823545 2643 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6 [sys.catalog]: This master's current role is: LEADER
I20260619 13:51:07.824028 2576 ts_manager.cc:194] Registered new tserver with Master: 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481)
I20260619 13:51:07.824357 2645 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260619 13:51:07.827052 2645 catalog_manager.cc:679] Loaded metadata for table default.table_1623c8da7f1e42958362607cf3bed6f0 [id=2d3dc93800df4ce7bcaa51ca2d5172eb]
I20260619 13:51:07.827540 2645 catalog_manager.cc:679] Loaded metadata for table default.table_06260aeaf35a4709a2f2596a0268c737 [id=2f052b286bee49df9c7ae8cd8ecfd90b]
I20260619 13:51:07.827901 2645 catalog_manager.cc:679] Loaded metadata for table default.table_2138876d1fe74e81bfc560e2fb592a0e [id=57c8bf0937b84407ace807934df053c4]
I20260619 13:51:07.828275 2645 catalog_manager.cc:679] Loaded metadata for table default.table_08f0dacfa3d348c9ab0e8387f52e681a [id=7774d59813b44a19864817d47194e724]
I20260619 13:51:07.828603 2645 catalog_manager.cc:679] Loaded metadata for table default.table_71421a29531045198619e2e3d9383268 [id=8385a644150b489d9d4f61e2338d081e]
I20260619 13:51:07.829020 2645 catalog_manager.cc:679] Loaded metadata for table default.table_c1ef2fe395ec45c98ee34472a137d486 [id=9aea7bf089c54100afe5510f3b4ec4ae]
I20260619 13:51:07.829360 2645 catalog_manager.cc:679] Loaded metadata for table default.table_75fff73b19164084879700104d9a214c [id=c250a119cf6642b2ad489636485fceac]
I20260619 13:51:07.829747 2645 catalog_manager.cc:679] Loaded metadata for table default.table_6a76b7745ccc406facfc1fc1021b24d9 [id=d0fb54a9a55b4a3b83f7c809ef7d24ea]
I20260619 13:51:07.830081 2645 catalog_manager.cc:679] Loaded metadata for table default.table_8ba4a12b36bd4159a70fe23f31c1e862 [id=e009fdd5a6e2488f9f7bfa3ed6005316]
I20260619 13:51:07.832343 2645 tablet_loader.cc:96] loaded metadata for tablet 9260801313d44149bbd4d1246691e7df (table default.table_8ba4a12b36bd4159a70fe23f31c1e862 [id=e009fdd5a6e2488f9f7bfa3ed6005316])
I20260619 13:51:07.832669 2645 tablet_loader.cc:96] loaded metadata for tablet 99b7f1f73b6449698c36f420002318f6 (table default.table_c1ef2fe395ec45c98ee34472a137d486 [id=9aea7bf089c54100afe5510f3b4ec4ae])
I20260619 13:51:07.832995 2645 tablet_loader.cc:96] loaded metadata for tablet afd1f4707bec4f61b6001eb88426f985 (table default.table_06260aeaf35a4709a2f2596a0268c737 [id=2f052b286bee49df9c7ae8cd8ecfd90b])
I20260619 13:51:07.833287 2645 tablet_loader.cc:96] loaded metadata for tablet b1cf3f5226e7408d8eadb8d0fb670d7b (table default.table_6a76b7745ccc406facfc1fc1021b24d9 [id=d0fb54a9a55b4a3b83f7c809ef7d24ea])
I20260619 13:51:07.833626 2645 tablet_loader.cc:96] loaded metadata for tablet bf536238326544e7ba59cc441da29696 (table default.table_08f0dacfa3d348c9ab0e8387f52e681a [id=7774d59813b44a19864817d47194e724])
I20260619 13:51:07.834206 2645 tablet_loader.cc:96] loaded metadata for tablet d66b1eaa29454bb3bc8e2c493d01cb43 (table default.table_1623c8da7f1e42958362607cf3bed6f0 [id=2d3dc93800df4ce7bcaa51ca2d5172eb])
I20260619 13:51:07.834548 2645 tablet_loader.cc:96] loaded metadata for tablet d7f76b3a50b24ef380870ccd67510d57 (table default.table_71421a29531045198619e2e3d9383268 [id=8385a644150b489d9d4f61e2338d081e])
I20260619 13:51:07.834926 2645 tablet_loader.cc:96] loaded metadata for tablet da2d71631f364b6e86a17e113d7e8960 (table default.table_2138876d1fe74e81bfc560e2fb592a0e [id=57c8bf0937b84407ace807934df053c4])
I20260619 13:51:07.835366 2645 tablet_loader.cc:96] loaded metadata for tablet e637f2b405c445a1afee9cd9c9db8d08 (table default.table_75fff73b19164084879700104d9a214c [id=c250a119cf6642b2ad489636485fceac])
I20260619 13:51:07.835913 2645 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260619 13:51:07.837167 2645 catalog_manager.cc:1294] Loaded cluster ID: 83fe01e7c5804ae9b7b2307f12c08ec9
I20260619 13:51:07.837280 2645 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260619 13:51:07.838598 2645 catalog_manager.cc:1539] Loading token signing keys...
I20260619 13:51:07.839493 2645 catalog_manager.cc:6080] T 00000000000000000000000000000000 P 6184e94a3ec241bfa8d2e34ea579f8a6: Loaded TSK: 0
I20260619 13:51:07.840395 2645 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260619 13:51:07.841226 2645 catalog_manager.cc:1562] Loading latest processed Hive Metastore notification log event ID...
I20260619 13:51:07.842099 2645 catalog_manager.cc:5918] Last processed Hive Metastore notification event ID: -1
F20260619 13:51:07.858837 2490 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 1, previous 1; dumping first 2 out of 10 received events: NotificationEvent(eventId=1, eventTime=1781877043, eventType=CREATE_TABLE, dbName=default, tableName=table_2138876d1fe74e81bfc560e2fb592a0e, message={"server":"","servicePrincipal":"","db":"default","table":"table_2138876d1fe74e81bfc560e2fb592a0e","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_2138876d1fe74e81bfc560e2fb592a0e\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1781877043},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/warehouse/table_2138876d1fe74e81bfc560e2fb592a0e\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_2138876d1fe74e81bfc560e2fb592a0e\",\"kudu.table_id\":\"57c8bf0937b84407ace807934df053c4\",\"transient_lastDdlTime\":\"1781877043\",\"comment\":\"\",\"kudu.master_addresses\":\"127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"83fe01e7c5804ae9b7b2307f12c08ec9\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1781877043,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=1, eventTime=1781877043, eventType=CREATE_TABLE, dbName=default, tableName=table_c52ddc84a5e24c718eba7aab2234f558, message={"server":"","servicePrincipal":"","db":"default","table":"table_c52ddc84a5e24c718eba7aab2234f558","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_c52ddc84a5e24c718eba7aab2234f558\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1781877043},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/warehouse/table_c52ddc84a5e24c718eba7aab2234f558\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_c52ddc84a5e24c718eba7aab2234f558\",\"kudu.table_id\":\"b3b37daaec8c448a98386eb208b2cd04\",\"transient_lastDdlTime\":\"1781877043\",\"comment\":\"\",\"kudu.master_addresses\":\"127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"83fe01e7c5804ae9b7b2307f12c08ec9\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1781877043,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f121cefcdcd google::LogMessage::Fail() at ??:0
@ 0x7f121cf00b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f121cefc7cc google::LogMessage::Flush() at ??:0
@ 0x7f121cefca11 google::LogMessage::~LogMessage() at ??:0
@ 0x7f1233af7394 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f1233af5c41 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7f1233afd8bc kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
@ 0x7f1233afd739 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa681d std::function<>::operator()() at ??:?
@ 0x7f121fc23f49 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f12232ed6db start_thread at ??:0
@ 0x7f121bdab61f clone at ??:0
I20260619 13:51:07.928372 2576 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" instance_seqno: 1781877042220212) as {username='slave'} at 127.0.105.65:48111; Asking this server to re-register.
I20260619 13:51:07.929168 1114 heartbeater.cc:461] Registering TS with master...
I20260619 13:51:07.930729 2576 ts_manager.cc:194] Registered new tserver with Master: 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865)
W20260619 13:51:08.083698 1001 connection.cc:573] client connection to 127.0.105.124:40279 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 13:51:08.084018 1276 connection.cc:573] client connection to 127.0.105.124:40279 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 13:51:08.084147 1395 connection.cc:573] client connection to 127.0.105.124:40279 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260619 13:51:08.542786 2662 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:08.543013 2662 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:08.544817 2662 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:51:08.545928 2562 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:51:08.547115 2560 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:51:08.547283 2562 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:51:08.547459 2562 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:51:08.547808 2662 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260619 13:51:09.079838 2670 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:09.080058 2670 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:09.080730 2670 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:51:09.082984 2562 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:51:09.083186 2560 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:51:09.083312 2560 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:51:09.083554 2670 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260619 13:51:09.745724 2676 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:09.745903 2676 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:09.746655 2676 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:51:09.748603 2562 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:51:09.748824 2560 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:51:09.748982 2560 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:51:09.749269 2676 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260619 13:51:10.290663 421 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
/tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.125:37003
--webserver_interface=127.0.105.125
--webserver_port=36357
--builtin_ntp_servers=127.0.105.84:41509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--hive_metastore_uris=thrift://127.0.0.1:39807
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260619 13:51:10.507570 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 11: this message will repeat every 5th retry.
W20260619 13:51:10.643056 2686 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 13:51:10.643411 2686 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 13:51:10.643539 2686 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260619 13:51:10.652482 2686 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 13:51:10.652578 2686 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260619 13:51:10.652664 2686 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 13:51:10.652737 2686 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260619 13:51:10.664032 2686 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.84:41509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:39807
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.125:37003
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.105.125
--webserver_port=36357
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 19 Jun 2026 13:43:23 UTC on bdcb31816ec0
build id 12470
ASAN enabled
I20260619 13:51:10.665802 2686 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 13:51:10.667829 2686 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260619 13:51:10.676689 2692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:51:10.677004 2691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:51:10.677495 2694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 13:51:10.678117 2686 server_base.cc:1061] running on GCE node
I20260619 13:51:10.678848 2686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 13:51:10.680339 2686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 13:51:10.681654 2686 hybrid_clock.cc:648] HybridClock initialized: now 1781877070681565 us; error 65 us; skew 500 ppm
I20260619 13:51:10.682013 2686 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 13:51:10.684122 2686 webserver.cc:533] Webserver started at http://127.0.105.125:36357/ using document root <none> and password file <none>
I20260619 13:51:10.684994 2686 fs_manager.cc:362] Metadata directory not provided
I20260619 13:51:10.685091 2686 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 13:51:10.690723 2686 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260619 13:51:10.693707 2700 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 13:51:10.695122 2686 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260619 13:51:10.695308 2686 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data,/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/wal
uuid: "fe5c828398bf4cd592f4a0b084a304b7"
format_stamp: "Formatted at 2026-06-19 13:50:40 on dist-test-slave-7hnr"
I20260619 13:51:10.696126 2686 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 13:51:10.722709 2686 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260619 13:51:10.723663 2686 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 13:51:10.723973 2686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 13:51:10.745272 2686 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.125:37003
I20260619 13:51:10.745291 2751 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.125:37003 every 8 connection(s)
I20260619 13:51:10.747032 2686 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-1/data/info.pb
I20260619 13:51:10.753372 421 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu as pid 2686
I20260619 13:51:10.754142 2752 sys_catalog.cc:263] Verifying existing consensus state
I20260619 13:51:10.758880 2752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: Bootstrap starting.
I20260619 13:51:10.775942 2752 log.cc:826] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: Log is configured to *not* fsync() on all Append() calls
I20260619 13:51:10.808856 2752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: Bootstrap replayed 1/1 log segments. Stats: ops{read=43 overwritten=0 applied=43 ignored=0} inserts{seen=28 ignored=0} mutations{seen=29 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 13:51:10.809477 2752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: Bootstrap complete.
I20260619 13:51:10.814841 2752 raft_consensus.cc:359] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:10.815546 2752 raft_consensus.cc:740] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe5c828398bf4cd592f4a0b084a304b7, State: Initialized, Role: FOLLOWER
I20260619 13:51:10.816166 2752 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 43, Last appended: 5.43, Last appended by leader: 43, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:10.816926 2757 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:51:10.817236 2757 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 13:51:10.818044 2752 sys_catalog.cc:565] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 13:51:10.828249 2773 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260619 13:51:10.828742 1252 heartbeater.cc:344] Connected to a master server at 127.0.105.125:37003
I20260619 13:51:10.833762 2716 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "94599283b9334819b3bbe25509b7cd16" instance_seqno: 1781877042768620) as {username='slave'} at 127.0.105.66:41973; Asking this server to re-register.
I20260619 13:51:10.834981 1252 heartbeater.cc:461] Registering TS with master...
I20260619 13:51:10.839372 2716 ts_manager.cc:194] Registered new tserver with Master: 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481)
I20260619 13:51:10.861129 2686 master_runner.cc:187] Error getting master registration for 127.0.105.124:40279: Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111),
I20260619 13:51:10.864645 2686 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:51:10.917479 2776 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:10.917788 2776 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:10.918557 2776 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:51:10.921260 2560 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:51:10.927307 2727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7adca601777549878be161a6116e53b6" candidate_term: 7 candidate_status { last_received { term: 3 index: 37 } } ignore_live_leader: false dest_uuid: "fe5c828398bf4cd592f4a0b084a304b7" is_pre_election: true
I20260619 13:51:10.928081 2727 raft_consensus.cc:2410] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7adca601777549878be161a6116e53b6 for term 7 because replica has last-logged OpId of term: 5 index: 43, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 37.
I20260619 13:51:10.928328 1115 heartbeater.cc:344] Connected to a master server at 127.0.105.125:37003
I20260619 13:51:10.928882 2562 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:51:10.929247 2776 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260619 13:51:10.929873 2716 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" instance_seqno: 1781877042220212) as {username='slave'} at 127.0.105.65:34363; Asking this server to re-register.
I20260619 13:51:10.930457 1115 heartbeater.cc:461] Registering TS with master...
I20260619 13:51:10.931711 2716 ts_manager.cc:194] Registered new tserver with Master: 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865)
I20260619 13:51:11.014150 1390 heartbeater.cc:344] Connected to a master server at 127.0.105.125:37003
I20260619 13:51:11.015802 2716 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" instance_seqno: 1781877043287674) as {username='slave'} at 127.0.105.67:41063; Asking this server to re-register.
I20260619 13:51:11.016371 1390 heartbeater.cc:461] Registering TS with master...
I20260619 13:51:11.017705 2716 ts_manager.cc:194] Registered new tserver with Master: d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
I20260619 13:51:11.308779 2757 raft_consensus.cc:493] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:11.309168 2757 raft_consensus.cc:515] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:11.311182 2757 leader_election.cc:290] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
I20260619 13:51:11.311861 2586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fe5c828398bf4cd592f4a0b084a304b7" candidate_term: 6 candidate_status { last_received { term: 5 index: 43 } } ignore_live_leader: false dest_uuid: "7adca601777549878be161a6116e53b6" is_pre_election: true
W20260619 13:51:11.311995 2701 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:51:11.312238 2586 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe5c828398bf4cd592f4a0b084a304b7 in current term 6: Already voted for candidate 6184e94a3ec241bfa8d2e34ea579f8a6 in this term.
W20260619 13:51:11.313700 2701 leader_election.cc:336] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:51:11.313867 2701 leader_election.cc:304] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe5c828398bf4cd592f4a0b084a304b7; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, 7adca601777549878be161a6116e53b6
I20260619 13:51:11.314231 2757 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 5 FOLLOWER]: Advancing to term 6
I20260619 13:51:11.318084 2757 raft_consensus.cc:2749] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260619 13:51:11.833097 2773 catalog_manager.cc:1294] Loaded cluster ID: 83fe01e7c5804ae9b7b2307f12c08ec9
I20260619 13:51:11.833201 2773 catalog_manager.cc:1587] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: loading cluster ID for follower catalog manager: success
I20260619 13:51:11.836472 2773 catalog_manager.cc:1609] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: acquiring CA information for follower catalog manager: success
I20260619 13:51:11.838835 2773 catalog_manager.cc:1637] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 13:51:12.020671 2792 raft_consensus.cc:493] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:12.020907 2792 raft_consensus.cc:515] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:12.022042 2792 leader_election.cc:290] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
I20260619 13:51:12.022423 2586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fe5c828398bf4cd592f4a0b084a304b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 43 } } ignore_live_leader: false dest_uuid: "7adca601777549878be161a6116e53b6" is_pre_election: true
I20260619 13:51:12.022675 2586 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe5c828398bf4cd592f4a0b084a304b7 in term 6.
I20260619 13:51:12.023278 2703 leader_election.cc:304] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7adca601777549878be161a6116e53b6, fe5c828398bf4cd592f4a0b084a304b7; no voters:
I20260619 13:51:12.023631 2792 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260619 13:51:12.023783 2792 raft_consensus.cc:493] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 13:51:12.023902 2792 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 6 FOLLOWER]: Advancing to term 7
W20260619 13:51:12.025009 2701 leader_election.cc:336] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:51:12.027137 2792 raft_consensus.cc:515] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:12.027855 2792 leader_election.cc:290] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 7 election: Requested vote from peers 7adca601777549878be161a6116e53b6 (127.0.105.126:34929), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
I20260619 13:51:12.028309 2586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fe5c828398bf4cd592f4a0b084a304b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 43 } } ignore_live_leader: false dest_uuid: "7adca601777549878be161a6116e53b6"
I20260619 13:51:12.028540 2586 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 6 FOLLOWER]: Advancing to term 7
W20260619 13:51:12.029346 2701 leader_election.cc:336] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:51:12.031371 2586 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe5c828398bf4cd592f4a0b084a304b7 in term 7.
I20260619 13:51:12.031867 2703 leader_election.cc:304] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7adca601777549878be161a6116e53b6, fe5c828398bf4cd592f4a0b084a304b7; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6
I20260619 13:51:12.032186 2792 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 7 FOLLOWER]: Leader election won for term 7
I20260619 13:51:12.032684 2792 raft_consensus.cc:697] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [term 7 LEADER]: Becoming Leader. State: Replica: fe5c828398bf4cd592f4a0b084a304b7, State: Running, Role: LEADER
I20260619 13:51:12.033179 2792 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 43, Committed index: 43, Last appended: 5.43, Last appended by leader: 43, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:12.036175 2795 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe5c828398bf4cd592f4a0b084a304b7. Latest consensus state: current_term: 7 leader_uuid: "fe5c828398bf4cd592f4a0b084a304b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:51:12.036489 2795 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [sys.catalog]: This master's current role is: LEADER
I20260619 13:51:12.037386 2797 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260619 13:51:12.039983 2797 catalog_manager.cc:679] Loaded metadata for table default.table_1623c8da7f1e42958362607cf3bed6f0 [id=2d3dc93800df4ce7bcaa51ca2d5172eb]
I20260619 13:51:12.040462 2797 catalog_manager.cc:679] Loaded metadata for table default.table_06260aeaf35a4709a2f2596a0268c737 [id=2f052b286bee49df9c7ae8cd8ecfd90b]
I20260619 13:51:12.040861 2797 catalog_manager.cc:679] Loaded metadata for table default.table_2138876d1fe74e81bfc560e2fb592a0e [id=57c8bf0937b84407ace807934df053c4]
I20260619 13:51:12.041252 2797 catalog_manager.cc:679] Loaded metadata for table default.table_08f0dacfa3d348c9ab0e8387f52e681a [id=7774d59813b44a19864817d47194e724]
I20260619 13:51:12.041730 2797 catalog_manager.cc:679] Loaded metadata for table default.table_71421a29531045198619e2e3d9383268 [id=8385a644150b489d9d4f61e2338d081e]
I20260619 13:51:12.042176 2797 catalog_manager.cc:679] Loaded metadata for table default.table_c1ef2fe395ec45c98ee34472a137d486 [id=9aea7bf089c54100afe5510f3b4ec4ae]
I20260619 13:51:12.042538 2797 catalog_manager.cc:679] Loaded metadata for table default.table_75fff73b19164084879700104d9a214c [id=c250a119cf6642b2ad489636485fceac]
I20260619 13:51:12.042914 2797 catalog_manager.cc:679] Loaded metadata for table default.table_6a76b7745ccc406facfc1fc1021b24d9 [id=d0fb54a9a55b4a3b83f7c809ef7d24ea]
I20260619 13:51:12.043272 2797 catalog_manager.cc:679] Loaded metadata for table default.table_8ba4a12b36bd4159a70fe23f31c1e862 [id=e009fdd5a6e2488f9f7bfa3ed6005316]
I20260619 13:51:12.045852 2797 tablet_loader.cc:96] loaded metadata for tablet 9260801313d44149bbd4d1246691e7df (table default.table_8ba4a12b36bd4159a70fe23f31c1e862 [id=e009fdd5a6e2488f9f7bfa3ed6005316])
I20260619 13:51:12.046180 2797 tablet_loader.cc:96] loaded metadata for tablet 99b7f1f73b6449698c36f420002318f6 (table default.table_c1ef2fe395ec45c98ee34472a137d486 [id=9aea7bf089c54100afe5510f3b4ec4ae])
I20260619 13:51:12.046505 2797 tablet_loader.cc:96] loaded metadata for tablet afd1f4707bec4f61b6001eb88426f985 (table default.table_06260aeaf35a4709a2f2596a0268c737 [id=2f052b286bee49df9c7ae8cd8ecfd90b])
I20260619 13:51:12.046828 2797 tablet_loader.cc:96] loaded metadata for tablet b1cf3f5226e7408d8eadb8d0fb670d7b (table default.table_6a76b7745ccc406facfc1fc1021b24d9 [id=d0fb54a9a55b4a3b83f7c809ef7d24ea])
I20260619 13:51:12.047142 2797 tablet_loader.cc:96] loaded metadata for tablet bf536238326544e7ba59cc441da29696 (table default.table_08f0dacfa3d348c9ab0e8387f52e681a [id=7774d59813b44a19864817d47194e724])
I20260619 13:51:12.047780 2797 tablet_loader.cc:96] loaded metadata for tablet d66b1eaa29454bb3bc8e2c493d01cb43 (table default.table_1623c8da7f1e42958362607cf3bed6f0 [id=2d3dc93800df4ce7bcaa51ca2d5172eb])
I20260619 13:51:12.048163 2797 tablet_loader.cc:96] loaded metadata for tablet d7f76b3a50b24ef380870ccd67510d57 (table default.table_71421a29531045198619e2e3d9383268 [id=8385a644150b489d9d4f61e2338d081e])
I20260619 13:51:12.048462 2797 tablet_loader.cc:96] loaded metadata for tablet da2d71631f364b6e86a17e113d7e8960 (table default.table_2138876d1fe74e81bfc560e2fb592a0e [id=57c8bf0937b84407ace807934df053c4])
I20260619 13:51:12.048765 2797 tablet_loader.cc:96] loaded metadata for tablet e637f2b405c445a1afee9cd9c9db8d08 (table default.table_75fff73b19164084879700104d9a214c [id=c250a119cf6642b2ad489636485fceac])
I20260619 13:51:12.049211 2797 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260619 13:51:12.050386 2797 catalog_manager.cc:1294] Loaded cluster ID: 83fe01e7c5804ae9b7b2307f12c08ec9
I20260619 13:51:12.050515 2797 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260619 13:51:12.052515 2797 catalog_manager.cc:1539] Loading token signing keys...
I20260619 13:51:12.054008 2797 catalog_manager.cc:6080] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: Loaded TSK: 0
I20260619 13:51:12.054949 2797 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260619 13:51:12.056092 2797 catalog_manager.cc:1562] Loading latest processed Hive Metastore notification log event ID...
I20260619 13:51:12.057096 2797 catalog_manager.cc:5918] Last processed Hive Metastore notification event ID: -1
I20260619 13:51:12.203693 2717 master_service.cc:960] ReplaceTablet: received request to replace tablet d66b1eaa29454bb3bc8e2c493d01cb43 from {username='slave'} at 127.0.0.1:59038
I20260619 13:51:12.204356 2715 master_service.cc:960] ReplaceTablet: received request to replace tablet afd1f4707bec4f61b6001eb88426f985 from {username='slave'} at 127.0.0.1:59038
I20260619 13:51:12.206146 2710 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59038:
name: "default.Table_0a1998b5c2b34b7ab34528ad19b3cf84"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:51:12.207398 2709 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59038:
table { table_name: "default.Table_71421a29531045198619e2e3d9383268" } modify_external_catalogs: true
I20260619 13:51:12.207705 2709 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59038:
table { table_name: "default.Table_71421a29531045198619e2e3d9383268" } modify_external_catalogs: true
I20260619 13:51:12.207799 2712 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59038:
table { table_name: "default.Table_8ba4a12b36bd4159a70fe23f31c1e862" } modify_external_catalogs: true
I20260619 13:51:12.208094 2712 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59038:
table { table_name: "default.Table_8ba4a12b36bd4159a70fe23f31c1e862" } modify_external_catalogs: true
I20260619 13:51:12.206104 2708 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59038:
name: "default.Table_04077192a2444da49f04c39c741733bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:51:12.208401 2713 master_service.cc:960] ReplaceTablet: received request to replace tablet 0fd56579c7a44155a0090e2720566a58 from {username='slave'} at 127.0.0.1:59038
I20260619 13:51:12.209282 2713 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59038:
table { table_name: "default.Table_08f0dacfa3d348c9ab0e8387f52e681a" } modify_external_catalogs: true
I20260619 13:51:12.209532 2713 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59038:
table { table_name: "default.Table_08f0dacfa3d348c9ab0e8387f52e681a" } modify_external_catalogs: true
I20260619 13:51:12.209972 2714 master_service.cc:960] ReplaceTablet: received request to replace tablet 9260801313d44149bbd4d1246691e7df from {username='slave'} at 127.0.0.1:59038
I20260619 13:51:12.211985 2711 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59038:
name: "default.Table_6b5ec95d9cfd4a979c14eac5784df343"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 13:51:12.212169 2586 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Refusing update from remote peer fe5c828398bf4cd592f4a0b084a304b7: Log matching property violated. Preceding OpId in replica: term: 3 index: 37. Preceding OpId from leader: term: 7 index: 45. (index mismatch)
I20260619 13:51:12.212960 2792 consensus_queue.cc:1048] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 44, Last known committed idx: 37, Time since last communication: 0.000s
W20260619 13:51:12.217036 2701 consensus_peers.cc:597] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7 -> Peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Couldn't send request to peer 6184e94a3ec241bfa8d2e34ea579f8a6. Status: Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260619 13:51:12.207932 2716 master_service.cc:960] ReplaceTablet: received request to replace tablet 0fd56579c7a44155a0090e2720566a58 from {username='slave'} at 127.0.0.1:59038
I20260619 13:51:12.218303 2716 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59038:
name: "default.Table_59c8023d6dec4ca985120f5dbf942dc8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
F20260619 13:51:12.220216 2770 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 1, previous 1; dumping first 2 out of 10 received events: NotificationEvent(eventId=1, eventTime=1781877043, eventType=CREATE_TABLE, dbName=default, tableName=table_2138876d1fe74e81bfc560e2fb592a0e, message={"server":"","servicePrincipal":"","db":"default","table":"table_2138876d1fe74e81bfc560e2fb592a0e","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_2138876d1fe74e81bfc560e2fb592a0e\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1781877043},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/warehouse/table_2138876d1fe74e81bfc560e2fb592a0e\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_2138876d1fe74e81bfc560e2fb592a0e\",\"kudu.table_id\":\"57c8bf0937b84407ace807934df053c4\",\"transient_lastDdlTime\":\"1781877043\",\"comment\":\"\",\"kudu.master_addresses\":\"127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"83fe01e7c5804ae9b7b2307f12c08ec9\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1781877043,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=1, eventTime=1781877043, eventType=CREATE_TABLE, dbName=default, tableName=table_c52ddc84a5e24c718eba7aab2234f558, message={"server":"","servicePrincipal":"","db":"default","table":"table_c52ddc84a5e24c718eba7aab2234f558","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_c52ddc84a5e24c718eba7aab2234f558\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1781877043},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/warehouse/table_c52ddc84a5e24c718eba7aab2234f558\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_c52ddc84a5e24c718eba7aab2234f558\",\"kudu.table_id\":\"b3b37daaec8c448a98386eb208b2cd04\",\"transient_lastDdlTime\":\"1781877043\",\"comment\":\"\",\"kudu.master_addresses\":\"127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"83fe01e7c5804ae9b7b2307f12c08ec9\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1781877043,"files":[]}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7fab44637dcd google::LogMessage::Fail() at ??:0
@ 0x7fab4463bb93 google::LogMessage::SendToLog() at ??:0
@ 0x7fab446377cc google::LogMessage::Flush() at ??:0
@ 0x7fab44637a11 google::LogMessage::~LogMessage() at ??:0
@ 0x7fab5b232394 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260619 13:51:12.239696 2807 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "fe5c828398bf4cd592f4a0b084a304b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:51:12.239992 2807 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7fab5b230c41 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260619 13:51:12.241088 2801 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe5c828398bf4cd592f4a0b084a304b7. Latest consensus state: current_term: 7 leader_uuid: "fe5c828398bf4cd592f4a0b084a304b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:51:12.241771 2801 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 13:51:12.241413 2805 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "fe5c828398bf4cd592f4a0b084a304b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:51:12.241972 2805 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 13:51:12.244184 2799 mvcc.cc:204] Tried to move back new op lower bound from 7298568487769776128 to 7298568487051624448. Current Snapshot: MvccSnapshot[applied={T|T < 7298568487769776128}]
I20260619 13:51:12.245807 2805 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "fe5c828398bf4cd592f4a0b084a304b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:51:12.246008 2805 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 13:51:12.251902 2802 mvcc.cc:204] Tried to move back new op lower bound from 7298568487789268992 to 7298568410410721280. Current Snapshot: MvccSnapshot[applied={T|T < 7298568487789268992 or (T in {7298568487789268992})}]
I20260619 13:51:12.252610 2717 catalog_manager.cc:5983] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: Sending DeleteTablet for 3 replicas of tablet d66b1eaa29454bb3bc8e2c493d01cb43
@ 0x7fab5b2388bc kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260619 13:51:12.252611 2715 catalog_manager.cc:5983] T 00000000000000000000000000000000 P fe5c828398bf4cd592f4a0b084a304b7: Sending DeleteTablet for 3 replicas of tablet afd1f4707bec4f61b6001eb88426f985
I20260619 13:51:12.257490 2715 catalog_manager.cc:6784] ReplaceTablet: tablet afd1f4707bec4f61b6001eb88426f985 deleted and replaced by tablet f057866c4ae842f7a28ae4bba4ad73f6
@ 0x7fab5b238739 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xaa681d std::function<>::operator()() at ??:?
@ 0x7fab4735ef49 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fab4aa286db start_thread at ??:0
I20260619 13:51:12.269721 2717 catalog_manager.cc:6784] ReplaceTablet: tablet d66b1eaa29454bb3bc8e2c493d01cb43 deleted and replaced by tablet 0d9306bfc36c4973a0e5cf5bc4c3823d
@ 0x7fab434e661f clone at ??:0
W20260619 13:51:12.451290 2816 negotiation.cc:336] Failed RPC negotiation. Trace:
0619 13:51:12.256451 (+ 0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:55848 (local address 127.0.105.66:33481)
0619 13:51:12.271338 (+ 14887us) server_negotiation.cc:207] Beginning negotiation
0619 13:51:12.271345 (+ 7us) server_negotiation.cc:400] Waiting for connection header
0619 13:51:12.271375 (+ 30us) server_negotiation.cc:408] Connection header received
0619 13:51:12.271482 (+ 107us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0619 13:51:12.271490 (+ 8us) server_negotiation.cc:462] Received NEGOTIATE request from client
0619 13:51:12.271599 (+ 109us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0619 13:51:12.271729 (+ 130us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0619 13:51:12.451025 (+179296us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55848: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":14369,"thread_start_us":14838,"threads_started":1}
W20260619 13:51:12.451292 2818 negotiation.cc:336] Failed RPC negotiation. Trace:
0619 13:51:12.259473 (+ 0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:48668 (local address 127.0.105.67:33847)
0619 13:51:12.268865 (+ 9392us) server_negotiation.cc:207] Beginning negotiation
0619 13:51:12.268875 (+ 10us) server_negotiation.cc:400] Waiting for connection header
0619 13:51:12.269600 (+ 725us) server_negotiation.cc:408] Connection header received
0619 13:51:12.451044 (+181444us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48668: BlockingRecv error: recv got EOF from 127.0.0.1:48668 (error 108)
Metrics: {"server-negotiator.queue_time_us":9248,"thread_start_us":9164,"threads_started":1}
W20260619 13:51:12.451793 1278 connection.cc:573] client connection to 127.0.105.125:37003 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 13:51:12.451872 1003 connection.cc:573] client connection to 127.0.105.125:37003 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 13:51:12.452052 2815 negotiation.cc:336] Failed RPC negotiation. Trace:
0619 13:51:12.255813 (+ 0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:44958 (local address 127.0.105.65:35865)
0619 13:51:12.272436 (+ 16623us) server_negotiation.cc:207] Beginning negotiation
0619 13:51:12.272449 (+ 13us) server_negotiation.cc:400] Waiting for connection header
0619 13:51:12.272465 (+ 16us) server_negotiation.cc:408] Connection header received
0619 13:51:12.272520 (+ 55us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0619 13:51:12.272524 (+ 4us) server_negotiation.cc:462] Received NEGOTIATE request from client
0619 13:51:12.272578 (+ 54us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0619 13:51:12.272690 (+ 112us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0619 13:51:12.451048 (+178358us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44958: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":16387,"thread_start_us":16302,"threads_started":1}
W20260619 13:51:12.452821 1397 connection.cc:573] client connection to 127.0.105.125:37003 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 13:51:12.453347 1140 connection.cc:573] client connection to 127.0.105.125:37003 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260619 13:51:12.453521 1397 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.105.125:37003)
W20260619 13:51:12.453881 1397 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.105.125:37003)
W20260619 13:51:12.454082 1397 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.105.125:37003)
W20260619 13:51:12.454607 1397 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.105.125:37003)
I20260619 13:51:12.508128 2541 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:51:12.508288 2541 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:51:12.745666 2805 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe5c828398bf4cd592f4a0b084a304b7)
I20260619 13:51:12.745891 2805 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:12.746626 2805 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:51:12.748517 2560 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:51:12.748859 2562 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:51:12.748991 2562 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:51:12.749265 2805 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260619 13:51:12.996881 421 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu pid 2541
I20260619 13:51:13.012841 2606 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 13:51:13.124225 421 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu with pid 2541
I20260619 13:51:13.705607 421 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
/tmp/dist-test-taskGUcKrL/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.126:34929
--webserver_interface=127.0.105.126
--webserver_port=45763
--builtin_ntp_servers=127.0.105.84:41509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--hive_metastore_uris=thrift://127.0.0.1:39807
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260619 13:51:14.054924 2845 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 13:51:14.055313 2845 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 13:51:14.055456 2845 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260619 13:51:14.064759 2845 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 13:51:14.064903 2845 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260619 13:51:14.065035 2845 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 13:51:14.065115 2845 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260619 13:51:14.075922 2845 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.105.84:41509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:39807
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.105.126:34929
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.105.126
--webserver_port=45763
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 19 Jun 2026 13:43:23 UTC on bdcb31816ec0
build id 12470
ASAN enabled
I20260619 13:51:14.077601 2845 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 13:51:14.079383 2845 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260619 13:51:14.088222 2853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:51:14.088250 2854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 13:51:14.090603 2856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 13:51:14.091111 2845 server_base.cc:1061] running on GCE node
I20260619 13:51:14.091802 2845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 13:51:14.093163 2845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 13:51:14.094363 2845 hybrid_clock.cc:648] HybridClock initialized: now 1781877074094313 us; error 41 us; skew 500 ppm
I20260619 13:51:14.094738 2845 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 13:51:14.096947 2845 webserver.cc:533] Webserver started at http://127.0.105.126:45763/ using document root <none> and password file <none>
I20260619 13:51:14.097776 2845 fs_manager.cc:362] Metadata directory not provided
I20260619 13:51:14.097896 2845 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 13:51:14.103477 2845 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260619 13:51:14.106541 2862 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 13:51:14.108032 2845 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260619 13:51:14.108227 2845 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/data,/tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/wal
uuid: "7adca601777549878be161a6116e53b6"
format_stamp: "Formatted at 2026-06-19 13:50:40 on dist-test-slave-7hnr"
I20260619 13:51:14.109167 2845 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 13:51:14.136157 2845 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260619 13:51:14.137092 2845 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 13:51:14.137395 2845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 13:51:14.158514 2845 rpc_server.cc:307] RPC server started. Bound to: 127.0.105.126:34929
I20260619 13:51:14.158533 2913 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.105.126:34929 every 8 connection(s)
I20260619 13:51:14.160243 2845 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskGUcKrL/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1781877024041866-421-0/minicluster-data/master-0/data/info.pb
I20260619 13:51:14.165946 421 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskGUcKrL/build/asan/bin/kudu as pid 2845
I20260619 13:51:14.167567 2914 sys_catalog.cc:263] Verifying existing consensus state
I20260619 13:51:14.171911 2914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6: Bootstrap starting.
I20260619 13:51:14.187757 2914 log.cc:826] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6: Log is configured to *not* fsync() on all Append() calls
I20260619 13:51:14.224253 2914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6: Bootstrap replayed 1/1 log segments. Stats: ops{read=47 overwritten=0 applied=47 ignored=0} inserts{seen=31 ignored=0} mutations{seen=32 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 13:51:14.224900 2914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6: Bootstrap complete.
I20260619 13:51:14.230407 2914 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:14.231158 2914 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7adca601777549878be161a6116e53b6, State: Initialized, Role: FOLLOWER
I20260619 13:51:14.231848 2914 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 47, Last appended: 7.47, Last appended by leader: 47, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:14.232717 2919 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } } }
I20260619 13:51:14.233132 2919 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 13:51:14.234081 2914 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 13:51:14.256454 2933 catalog_manager.cc:1294] Loaded cluster ID: 83fe01e7c5804ae9b7b2307f12c08ec9
I20260619 13:51:14.256683 2933 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6: loading cluster ID for follower catalog manager: success
I20260619 13:51:14.261740 2933 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6: acquiring CA information for follower catalog manager: success
I20260619 13:51:14.264850 2933 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 13:51:14.266311 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:51:14.272053 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:51:14.329911 1389 heartbeater.cc:344] Connected to a master server at 127.0.105.126:34929
I20260619 13:51:14.333530 2879 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" instance_seqno: 1781877043287674) as {username='slave'} at 127.0.105.67:39915; Asking this server to re-register.
I20260619 13:51:14.334384 1389 heartbeater.cc:461] Registering TS with master...
I20260619 13:51:14.336540 2879 ts_manager.cc:194] Registered new tserver with Master: d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
I20260619 13:51:14.359040 1251 heartbeater.cc:344] Connected to a master server at 127.0.105.126:34929
I20260619 13:51:14.360669 2879 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "94599283b9334819b3bbe25509b7cd16" instance_seqno: 1781877042768620) as {username='slave'} at 127.0.105.66:52843; Asking this server to re-register.
I20260619 13:51:14.361307 1251 heartbeater.cc:461] Registering TS with master...
I20260619 13:51:14.362908 2879 ts_manager.cc:194] Registered new tserver with Master: 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481)
I20260619 13:51:14.465015 1114 heartbeater.cc:344] Connected to a master server at 127.0.105.126:34929
I20260619 13:51:14.466512 2879 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" instance_seqno: 1781877042220212) as {username='slave'} at 127.0.105.65:48875; Asking this server to re-register.
I20260619 13:51:14.467100 1114 heartbeater.cc:461] Registering TS with master...
I20260619 13:51:14.468425 2879 ts_manager.cc:194] Registered new tserver with Master: 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865)
I20260619 13:51:14.680655 2919 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:14.680972 2919 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:14.683045 2919 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:51:14.683647 2865 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:51:14.684870 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:51:14.685066 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:51:14.685235 2865 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:51:14.685690 2919 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260619 13:51:15.291944 2944 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:15.292169 2944 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:15.292941 2944 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:51:15.295200 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:51:15.295708 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:51:15.295887 2863 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:51:15.296140 2944 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260619 13:51:15.714910 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 16: this message will repeat every 5th retry.
I20260619 13:51:16.207458 2953 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:16.207671 2953 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:16.208415 2953 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:51:16.211225 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:51:16.211422 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:51:16.211539 2865 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:51:16.211835 2953 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260619 13:51:16.693740 421 master-stress-test.cc:579] Killing test thread 1/25
I20260619 13:51:16.727382 2961 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:16.727627 2961 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:16.728406 2961 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:51:16.730487 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:51:16.730700 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:51:16.730862 2863 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:51:16.731309 2961 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260619 13:51:17.440462 2969 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:17.440691 2969 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:17.441421 2969 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:51:17.443683 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:51:17.443898 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:51:17.444056 2865 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:51:17.444319 2969 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260619 13:51:17.505332 2366 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:17.505577 2366 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:51:17.506232 2366 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:51:17.507161 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:51:17.507387 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:51:17.507525 1002 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:51:17.507777 2366 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 13:51:19.275295 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:51:19.275462 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:51:20.173988 2990 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:20.174187 2990 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:20.174944 2990 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:51:20.175942 2865 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20260619 13:51:20.177147 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:51:20.177439 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:51:20.177657 2865 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:51:20.177887 2990 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260619 13:51:20.291487 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 16: this message will repeat every 5th retry.
I20260619 13:51:24.278169 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:51:24.278367 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:51:24.508975 3018 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:24.509244 3018 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:24.509974 3018 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:51:24.512867 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:51:24.513084 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:51:24.513211 2865 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:51:24.513427 3018 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260619 13:51:25.182235 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 21: this message will repeat every 5th retry.
I20260619 13:51:29.281086 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:51:29.281296 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:51:30.584857 3063 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:30.585057 3063 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:30.585858 3063 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:51:30.586869 2865 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260619 13:51:30.588047 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:51:30.588236 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:51:30.588389 2865 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:51:30.588658 3063 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260619 13:51:30.625792 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 21: this message will repeat every 5th retry.
I20260619 13:51:33.671041 3037 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:33.671253 3037 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:51:33.672154 3037 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:51:33.673234 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:51:33.673538 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:51:33.673743 1004 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:51:33.674016 3037 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 13:51:34.284368 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:51:34.284535 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:51:34.678386 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 26: this message will repeat every 5th retry.
I20260619 13:51:39.287405 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:51:39.287592 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:51:40.512528 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 26: this message will repeat every 5th retry.
I20260619 13:51:41.487330 3125 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:41.487496 3125 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:41.488108 3125 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:51:41.489078 2865 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260619 13:51:41.490267 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:51:41.490494 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:51:41.490597 2865 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:51:41.490808 3125 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260619 13:51:43.914111 1250 heartbeater.cc:646] Failed to heartbeat to 127.0.105.124:40279 (71 consecutive failures): Network error: Failed to ping master at 127.0.105.124:40279: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:51:44.033272 1115 heartbeater.cc:646] Failed to heartbeat to 127.0.105.125:37003 (63 consecutive failures): Network error: Failed to ping master at 127.0.105.125:37003: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:51:44.171252 1388 heartbeater.cc:646] Failed to heartbeat to 127.0.105.124:40279 (113 consecutive failures): Network error: Failed to ping master at 127.0.105.124:40279: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:51:44.290544 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:51:44.290727 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:51:44.382826 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 31: this message will repeat every 5th retry.
I20260619 13:51:46.279418 3152 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:46.279649 3152 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:51:46.280346 3152 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:51:46.281299 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:51:46.281570 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:51:46.281754 1002 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:51:46.282123 3152 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 13:51:48.397964 3169 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:48.398164 3169 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:48.398922 3169 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:51:48.400015 2863 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260619 13:51:48.401489 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:51:48.401737 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:51:48.401841 2863 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:51:48.402057 3169 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260619 13:51:49.293678 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:51:49.293852 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:51:50.843485 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 31: this message will repeat every 5th retry.
I20260619 13:51:51.688060 3191 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:51.688340 3191 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:51.689270 3191 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:51:51.692090 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:51:51.692530 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:51:51.692648 2863 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:51:51.692970 3191 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260619 13:51:53.894469 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 36: this message will repeat every 5th retry.
I20260619 13:51:54.296650 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:51:54.296871 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:51:54.970391 3162 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:54.970615 3162 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:51:54.971463 3162 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:51:54.972259 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:51:54.972430 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:51:54.972573 1004 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:51:54.972826 3162 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 13:51:56.316542 3223 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:51:56.316753 3223 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:51:56.317432 3223 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:51:56.318583 2863 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260619 13:51:56.319888 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:51:56.320055 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:51:56.320217 2863 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:51:56.320539 3223 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260619 13:51:59.300058 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:51:59.300230 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:52:00.276333 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 36: this message will repeat every 5th retry.
I20260619 13:52:04.303218 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:52:04.303436 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:52:04.597484 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 41: this message will repeat every 5th retry.
I20260619 13:52:09.306403 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:52:09.306598 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:52:10.501178 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 41: this message will repeat every 5th retry.
I20260619 13:52:14.310154 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:52:14.310313 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:52:14.723171 3303 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:52:14.723410 3303 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:52:14.724359 3303 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:52:14.725322 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:52:14.725538 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:52:14.725636 1002 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:52:14.725852 3303 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 13:52:14.852689 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 46: this message will repeat every 5th retry.
I20260619 13:52:16.094666 3351 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:52:16.094954 3351 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:52:16.095937 3351 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:52:16.097203 2865 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260619 13:52:16.098665 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:52:16.098809 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:52:16.098946 2863 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:52:16.099184 3351 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260619 13:52:19.313225 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:52:19.313403 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:52:20.479751 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 46: this message will repeat every 5th retry.
I20260619 13:52:24.316444 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:52:24.316664 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:52:25.148450 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 51: this message will repeat every 5th retry.
I20260619 13:52:28.285485 3403 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:52:28.285712 3403 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:52:28.286432 3403 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:52:28.287432 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:52:28.287604 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:52:28.287772 1004 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:52:28.288048 3403 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 13:52:29.319406 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:52:29.319623 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:52:30.811220 3447 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:52:30.811400 3447 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:52:30.812216 3447 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:52:30.813891 2865 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260619 13:52:30.815107 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:52:30.815296 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:52:30.815433 2865 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:52:30.815761 3447 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260619 13:52:31.081921 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 51: this message will repeat every 5th retry.
I20260619 13:52:33.452739 3464 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:52:33.452955 3464 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:52:33.453809 3464 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:52:33.456020 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:52:33.456210 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:52:33.456367 2863 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:52:33.456660 3464 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260619 13:52:34.322422 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:52:34.322662 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:52:36.069617 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 56: this message will repeat every 5th retry.
I20260619 13:52:38.271557 3451 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:52:38.271741 3451 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:52:38.272564 3451 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:52:38.273591 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:52:38.273769 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:52:38.273932 1004 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:52:38.274199 3451 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 13:52:39.325445 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:52:39.325721 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:52:40.492329 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 56: this message will repeat every 5th retry.
I20260619 13:52:41.684566 3522 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:52:41.684801 3522 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:52:41.685596 3522 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:52:41.686710 2865 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260619 13:52:41.688589 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:52:41.691660 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:52:41.691784 2863 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:52:41.692080 3522 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260619 13:52:44.064366 1250 heartbeater.cc:646] Failed to heartbeat to 127.0.105.124:40279 (191 consecutive failures): Network error: Failed to ping master at 127.0.105.124:40279: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:52:44.185647 1115 heartbeater.cc:646] Failed to heartbeat to 127.0.105.125:37003 (183 consecutive failures): Network error: Failed to ping master at 127.0.105.125:37003: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:52:44.321128 1388 heartbeater.cc:646] Failed to heartbeat to 127.0.105.124:40279 (299 consecutive failures): Network error: Failed to ping master at 127.0.105.124:40279: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:52:44.328240 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:52:44.328454 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:52:45.356407 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 61: this message will repeat every 5th retry.
I20260619 13:52:49.331266 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:52:49.331471 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:52:50.763056 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 61: this message will repeat every 5th retry.
I20260619 13:52:53.515547 3600 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:52:53.515758 3600 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:52:53.516480 3600 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:52:53.517571 2865 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260619 13:52:53.518915 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:52:53.519109 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:52:53.519236 2863 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:52:53.519505 3600 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260619 13:52:54.116183 3511 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:52:54.116374 3511 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:52:54.117285 3511 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:52:54.118187 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:52:54.118392 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:52:54.118571 1004 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:52:54.118854 3511 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 13:52:54.334530 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:52:54.334714 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:52:55.384099 3620 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:52:55.384346 3620 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:52:55.385016 3620 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:52:55.387406 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:52:55.387812 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:52:55.387914 2863 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:52:55.388154 3620 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260619 13:52:55.434580 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 66: this message will repeat every 5th retry.
I20260619 13:52:59.337373 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:52:59.337627 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:52:59.924886 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 66: this message will repeat every 5th retry.
I20260619 13:53:02.288851 3631 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:53:02.289068 3631 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:53:02.289800 3631 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:53:02.290771 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:53:02.290957 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:53:02.291111 1004 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:53:02.291369 3631 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 13:53:04.340472 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:53:04.340669 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:53:04.978251 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 71: this message will repeat every 5th retry.
I20260619 13:53:09.348996 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:53:09.349196 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:53:10.454725 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 71: this message will repeat every 5th retry.
I20260619 13:53:13.669425 3715 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:53:13.669739 3715 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:53:13.670658 3715 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:53:13.671723 2863 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260619 13:53:13.673087 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:53:13.673350 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:53:13.673453 2865 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:53:13.673728 3715 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260619 13:53:14.277066 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 76: this message will repeat every 5th retry.
I20260619 13:53:14.307683 2868 maintenance_manager.cc:419] P 7adca601777549878be161a6116e53b6: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033354
I20260619 13:53:14.352234 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:53:14.352428 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:53:14.354292 2867 maintenance_manager.cc:643] P 7adca601777549878be161a6116e53b6: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.046s user 0.023s sys 0.005s Metrics: {"bytes_written":13941,"cfile_init":1,"dirs.queue_time_us":356,"dirs.run_cpu_time_us":154,"dirs.run_wall_time_us":1139,"drs_written":1,"lbm_read_time_us":72,"lbm_reads_lt_1ms":4,"lbm_write_time_us":595,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":31,"thread_start_us":520,"threads_started":2,"wal-append.queue_time_us":371}
I20260619 13:53:14.355443 2868 maintenance_manager.cc:419] P 7adca601777549878be161a6116e53b6: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 1671 bytes on disk
I20260619 13:53:14.356099 2867 maintenance_manager.cc:643] P 7adca601777549878be161a6116e53b6: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":67,"lbm_reads_lt_1ms":4}
I20260619 13:53:17.621970 3724 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:53:17.622139 3724 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:53:17.623000 3724 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:53:17.623883 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:53:17.624027 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:53:17.624142 1004 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:53:17.624356 3724 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 13:53:19.355803 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:53:19.356002 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:53:20.723616 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 76: this message will repeat every 5th retry.
W20260619 13:53:24.061069 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 81: this message will repeat every 5th retry.
I20260619 13:53:24.359129 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:53:24.359331 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:53:29.362401 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:53:29.362656 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:53:30.567617 3867 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:53:30.567832 3867 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:53:30.568866 3867 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:53:30.570364 2865 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260619 13:53:30.571756 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:53:30.571964 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:53:30.572113 2863 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:53:30.572402 3867 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260619 13:53:31.220587 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 81: this message will repeat every 5th retry.
W20260619 13:53:34.333389 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 86: this message will repeat every 5th retry.
I20260619 13:53:34.366093 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:53:34.366299 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:53:36.078516 3903 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:53:36.078749 3903 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:53:36.079677 3903 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:53:36.080667 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:53:36.080900 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:53:36.081065 1002 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:53:36.081415 3903 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 13:53:39.369212 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:53:39.369412 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:53:39.667006 3903 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:53:39.667229 3903 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:53:39.668004 3903 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:53:39.668841 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:53:39.669050 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:53:39.669196 1004 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:53:39.669464 3903 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 13:53:41.071864 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 86: this message will repeat every 5th retry.
W20260619 13:53:44.218873 1250 heartbeater.cc:646] Failed to heartbeat to 127.0.105.124:40279 (311 consecutive failures): Network error: Failed to ping master at 127.0.105.124:40279: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:53:44.338944 1115 heartbeater.cc:646] Failed to heartbeat to 127.0.105.125:37003 (303 consecutive failures): Network error: Failed to ping master at 127.0.105.125:37003: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:53:44.372296 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:53:44.372538 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:53:44.402855 1390 heartbeater.cc:646] Failed to heartbeat to 127.0.105.125:37003 (474 consecutive failures): Network error: Failed to ping master at 127.0.105.125:37003: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:53:44.402993 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 91: this message will repeat every 5th retry.
I20260619 13:53:49.375514 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:53:49.375721 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:53:49.493157 4063 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:53:49.493418 4063 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:53:49.494331 4063 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:53:49.495011 2863 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260619 13:53:49.496471 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:53:49.496701 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:53:49.496810 2865 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:53:49.497107 4063 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260619 13:53:51.594621 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 91: this message will repeat every 5th retry.
W20260619 13:53:54.275918 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 96: this message will repeat every 5th retry.
I20260619 13:53:54.378823 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:53:54.379051 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:53:58.610173 4041 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:53:58.610394 4041 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:53:58.611302 4041 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:53:58.612180 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:53:58.612408 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:53:58.612563 1004 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:53:58.612830 4041 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 13:53:59.382064 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:53:59.382306 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:54:02.426168 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 96: this message will repeat every 5th retry.
W20260619 13:54:04.373574 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 101: this message will repeat every 5th retry.
I20260619 13:54:04.384975 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:54:04.385187 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:54:07.765417 4230 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:54:07.765725 4230 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:54:07.766618 4230 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:54:07.767694 2863 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260619 13:54:07.768862 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:54:07.769134 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:54:07.769224 2865 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:54:07.769526 4230 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260619 13:54:09.388150 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:54:09.388312 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:54:10.097906 4166 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:54:10.098168 4166 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:54:10.099277 4166 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:54:10.100193 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:54:10.100391 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:54:10.100513 1004 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:54:10.100772 4166 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 13:54:11.751602 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 101: this message will repeat every 5th retry.
W20260619 13:54:14.020326 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 106: this message will repeat every 5th retry.
I20260619 13:54:14.391266 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:54:14.391497 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:54:14.929787 4298 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:54:14.930034 4298 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:54:14.930912 4298 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:54:14.931785 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:54:14.931974 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:54:14.932068 1002 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:54:14.932313 4298 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 13:54:17.836864 4322 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:54:17.837149 4322 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:54:17.838043 4322 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:54:17.842286 2863 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260619 13:54:17.843787 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:54:17.844115 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:54:17.844440 2865 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:54:17.844815 4322 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260619 13:54:19.394517 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:54:19.394707 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:54:21.712777 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 106: this message will repeat every 5th retry.
I20260619 13:54:24.397399 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:54:24.397635 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:54:24.616343 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 111: this message will repeat every 5th retry.
I20260619 13:54:27.555567 4406 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:54:27.555806 4406 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:54:27.556602 4406 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:54:27.557574 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:54:27.557763 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:54:27.557870 1002 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:54:27.558149 4406 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 13:54:29.400705 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:54:29.400980 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:54:31.082073 4448 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:54:31.082314 4448 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:54:31.083284 4448 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:54:31.084486 2865 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260619 13:54:31.085778 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:54:31.085934 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:54:31.086099 2865 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:54:31.086519 4448 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260619 13:54:31.755823 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 111: this message will repeat every 5th retry.
I20260619 13:54:34.404004 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:54:34.404222 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:54:34.648012 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 116: this message will repeat every 5th retry.
I20260619 13:54:39.407451 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:54:39.407653 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:54:42.255292 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 116: this message will repeat every 5th retry.
I20260619 13:54:44.317989 4406 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:54:44.318190 4406 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:54:44.319096 4406 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:54:44.320017 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:54:44.320201 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:54:44.320290 1004 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:54:44.320506 4406 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 13:54:44.368376 1250 heartbeater.cc:646] Failed to heartbeat to 127.0.105.124:40279 (431 consecutive failures): Network error: Failed to ping master at 127.0.105.124:40279: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:54:44.410833 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:54:44.411043 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:54:44.493180 1115 heartbeater.cc:646] Failed to heartbeat to 127.0.105.125:37003 (423 consecutive failures): Network error: Failed to ping master at 127.0.105.125:37003: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:54:44.619455 4575 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:54:44.619735 4575 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:54:44.620572 4575 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:54:44.621462 1388 heartbeater.cc:646] Failed to heartbeat to 127.0.105.124:40279 (667 consecutive failures): Network error: Failed to ping master at 127.0.105.124:40279: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:54:44.621838 2863 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260619 13:54:44.623637 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:54:44.624204 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:54:44.624365 2865 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:54:44.624694 4575 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260619 13:54:45.262156 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 121: this message will repeat every 5th retry.
I20260619 13:54:48.401983 4614 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:54:48.402284 4614 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:54:48.403003 4614 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:54:48.405727 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:54:48.405916 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:54:48.406087 2865 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:54:48.406407 4614 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260619 13:54:49.414794 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:54:49.415001 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:54:49.626459 4406 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:54:49.626708 4406 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:54:49.627343 4406 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:54:49.628407 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:54:49.628608 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:54:49.628695 1004 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:54:49.628953 4406 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 13:54:52.657315 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 121: this message will repeat every 5th retry.
I20260619 13:54:54.418032 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:54:54.418227 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:54:55.879740 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 126: this message will repeat every 5th retry.
I20260619 13:54:59.421347 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:54:59.421589 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:55:01.269842 4728 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:55:01.270074 4728 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:55:01.270882 4728 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:55:01.273365 2865 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260619 13:55:01.275095 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:55:01.275460 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:55:01.275590 2863 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:55:01.275897 4728 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260619 13:55:02.283712 4647 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:55:02.283896 4647 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:55:02.284789 4647 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:55:02.285750 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:55:02.285969 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:55:02.286118 1004 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:55:02.286377 4647 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 13:55:02.964283 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 126: this message will repeat every 5th retry.
I20260619 13:55:04.424223 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:55:04.424467 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:55:05.848027 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 131: this message will repeat every 5th retry.
I20260619 13:55:07.414321 4792 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:55:07.414534 4792 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:55:07.415331 4792 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:55:07.416369 2863 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260619 13:55:07.417757 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:55:07.417917 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:55:07.418052 2865 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:55:07.418361 4792 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260619 13:55:09.427155 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:55:09.427367 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:55:12.755508 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 131: this message will repeat every 5th retry.
I20260619 13:55:12.974933 4846 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:55:12.975216 4846 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:55:12.976064 4846 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:55:12.977162 2865 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260619 13:55:12.979017 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:55:12.979216 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:55:12.979346 2863 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:55:12.979612 4846 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260619 13:55:14.430346 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:55:14.430560 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:55:15.829136 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 136: this message will repeat every 5th retry.
I20260619 13:55:17.185125 4854 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:55:17.185322 4854 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:55:17.186218 4854 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:55:17.187217 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:55:17.187450 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:55:17.187587 1004 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:55:17.187888 4854 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 13:55:19.433552 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:55:19.433789 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:55:22.152197 4923 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:55:22.152463 4923 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:55:22.153801 4923 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:55:22.154917 2865 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260619 13:55:22.156324 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:55:22.156522 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:55:22.156625 2865 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:55:22.156889 4923 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260619 13:55:22.669911 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 136: this message will repeat every 5th retry.
I20260619 13:55:23.066236 4934 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:55:23.066493 4934 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:55:23.067188 4934 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:55:23.069252 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:55:23.069425 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:55:23.069603 2865 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:55:23.069909 4934 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260619 13:55:24.437171 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:55:24.437366 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:55:25.123505 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 141: this message will repeat every 5th retry.
I20260619 13:55:26.333492 4969 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:55:26.333789 4969 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:55:26.334590 4969 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:55:26.337376 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:55:26.337932 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:55:26.338071 2865 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:55:26.338335 4969 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260619 13:55:29.440495 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:55:29.440681 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:55:32.906595 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 141: this message will repeat every 5th retry.
I20260619 13:55:34.443558 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:55:34.443751 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:55:35.832331 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 146: this message will repeat every 5th retry.
I20260619 13:55:36.691282 5029 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:55:36.691489 5029 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:55:36.692476 5029 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:55:36.693657 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:55:36.693874 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:55:36.693977 1002 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:55:36.694253 5029 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 13:55:38.173260 5074 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:55:38.173556 5074 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:55:38.174414 5074 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:55:38.175433 2865 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260619 13:55:38.178905 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:55:38.179139 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:55:38.179302 2865 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:55:38.179704 5074 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260619 13:55:39.446842 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:55:39.447053 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:55:42.627650 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 146: this message will repeat every 5th retry.
I20260619 13:55:44.450273 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:55:44.450434 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:55:44.526198 1250 heartbeater.cc:646] Failed to heartbeat to 127.0.105.124:40279 (551 consecutive failures): Network error: Failed to ping master at 127.0.105.124:40279: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:55:44.652262 1115 heartbeater.cc:646] Failed to heartbeat to 127.0.105.125:37003 (543 consecutive failures): Network error: Failed to ping master at 127.0.105.125:37003: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:55:45.002426 1390 heartbeater.cc:646] Failed to heartbeat to 127.0.105.125:37003 (838 consecutive failures): Network error: Failed to ping master at 127.0.105.125:37003: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:55:45.415387 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 151: this message will repeat every 5th retry.
I20260619 13:55:45.900668 5029 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:55:45.900879 5029 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:55:45.901630 5029 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:55:45.902639 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:55:45.902866 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:55:45.903008 1004 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:55:45.903252 5029 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 13:55:49.454067 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:55:49.454334 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:55:52.725641 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 151: this message will repeat every 5th retry.
I20260619 13:55:54.013607 5191 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:55:54.013808 5191 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:55:54.014802 5191 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:55:54.015806 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:55:54.016072 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:55:54.016242 1002 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:55:54.016557 5191 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 13:55:54.457059 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:55:54.457270 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:55:54.971421 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 156: this message will repeat every 5th retry.
I20260619 13:55:56.527706 5232 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:55:56.527930 5232 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:55:56.528915 5232 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:55:56.530000 2865 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260619 13:55:56.531467 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:55:56.531673 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:55:56.531778 2865 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:55:56.532011 5232 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260619 13:55:58.015386 5191 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:55:58.015586 5191 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:55:58.016408 5191 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:55:58.017412 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:55:58.017659 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:55:58.017800 1004 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:55:58.018087 5191 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 13:55:58.306119 5249 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:55:58.306366 5249 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:55:58.307097 5249 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:55:58.309453 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
W20260619 13:55:58.309688 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
I20260619 13:55:58.309799 2865 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:55:58.310040 5249 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260619 13:55:59.460546 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:55:59.460775 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260619 13:56:02.202680 5278 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:56:02.202898 5278 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:56:02.203657 5278 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:56:02.204556 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:56:02.204734 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:56:02.204835 1004 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:56:02.205051 5278 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260619 13:56:02.242331 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 156: this message will repeat every 5th retry.
I20260619 13:56:04.465770 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:56:04.465988 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:56:05.360422 1278 consensus_peers.cc:597] T 0fd56579c7a44155a0090e2720566a58 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd56579c7a44155a0090e2720566a58. This is attempt 161: this message will repeat every 5th retry.
I20260619 13:56:07.221230 5314 raft_consensus.cc:493] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:56:07.221449 5314 raft_consensus.cc:515] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "380c26fd105f454cbe8ef6b87e35f41f" member_type: VOTER last_known_addr { host: "127.0.105.65" port: 35865 } } peers { permanent_uuid: "94599283b9334819b3bbe25509b7cd16" member_type: VOTER last_known_addr { host: "127.0.105.66" port: 33481 } } peers { permanent_uuid: "d54f30d62f034b35a8e73ff525ba43d9" member_type: VOTER last_known_addr { host: "127.0.105.67" port: 33847 } }
I20260619 13:56:07.222152 5314 leader_election.cc:290] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481), d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847)
W20260619 13:56:07.223138 1002 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94599283b9334819b3bbe25509b7cd16 (127.0.105.66:33481): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
W20260619 13:56:07.223316 1004 leader_election.cc:343] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d54f30d62f034b35a8e73ff525ba43d9 (127.0.105.67:33847): Not found: Tablet not found: b1cf3f5226e7408d8eadb8d0fb670d7b
I20260619 13:56:07.223425 1004 leader_election.cc:304] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 380c26fd105f454cbe8ef6b87e35f41f; no voters: 94599283b9334819b3bbe25509b7cd16, d54f30d62f034b35a8e73ff525ba43d9
I20260619 13:56:07.223676 5314 raft_consensus.cc:2749] T b1cf3f5226e7408d8eadb8d0fb670d7b P 380c26fd105f454cbe8ef6b87e35f41f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 13:56:08.570183 5344 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 13:56:08.570423 5344 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7adca601777549878be161a6116e53b6" member_type: VOTER last_known_addr { host: "127.0.105.126" port: 34929 } } peers { permanent_uuid: "fe5c828398bf4cd592f4a0b084a304b7" member_type: VOTER last_known_addr { host: "127.0.105.125" port: 37003 } } peers { permanent_uuid: "6184e94a3ec241bfa8d2e34ea579f8a6" member_type: VOTER last_known_addr { host: "127.0.105.124" port: 40279 } }
I20260619 13:56:08.571234 5344 leader_election.cc:290] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003), 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279)
W20260619 13:56:08.572350 2865 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260619 13:56:08.573774 2865 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fe5c828398bf4cd592f4a0b084a304b7 (127.0.105.125:37003): Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111)
W20260619 13:56:08.573961 2863 leader_election.cc:336] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6184e94a3ec241bfa8d2e34ea579f8a6 (127.0.105.124:40279): Network error: Client connection negotiation failed: client connection to 127.0.105.124:40279: connect: Connection refused (error 111)
I20260619 13:56:08.574065 2863 leader_election.cc:304] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7adca601777549878be161a6116e53b6; no voters: 6184e94a3ec241bfa8d2e34ea579f8a6, fe5c828398bf4cd592f4a0b084a304b7
I20260619 13:56:08.574347 5344 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7adca601777549878be161a6116e53b6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260619 13:56:09.468840 2845 master_runner.cc:187] Error getting master registration for 127.0.105.125:37003: Network error: Client connection negotiation failed: client connection to 127.0.105.125:37003: connect: Connection refused (error 111),
I20260619 13:56:09.469079 2845 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260619 13:56:12.027539 1278 consensus_peers.cc:597] T c8d8f0fa96f04d2b9dd9e4a3e7c97041 P d54f30d62f034b35a8e73ff525ba43d9 -> Peer 380c26fd105f454cbe8ef6b87e35f41f (127.0.105.65:35865): Couldn't send request to peer 380c26fd105f454cbe8ef6b87e35f41f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d8f0fa96f04d2b9dd9e4a3e7c97041. This is attempt 161: this message will repeat every 5th retry.
I20260619 13:56:12.380285 2868 maintenance_manager.cc:419] P 7adca601777549878be161a6116e53b6: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 1671 bytes on disk
I20260619 13:56:12.385462 2867 maintenance_manager.cc:643] P 7adca601777549878be161a6116e53b6: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.005s user 0.005s sys 0.000s Metrics: {"dirs.queue_time_us":427,"dirs.run_cpu_time_us":197,"dirs.run_wall_time_us":197,"thread_start_us":557,"threads_started":2,"wal-append.queue_time_us":365}
W20260619 13:56:12.862645 1397 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
W20260619 13:56:12.862978 1397 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
W20260619 13:56:12.863076 1397 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
W20260619 13:56:12.863260 1397 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
F20260619 13:56:12.874131 1424 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
F20260619 13:56:12.874541 1412 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b08623aacbde40ed8d75707540765476 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874605 1406 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_387aecac34f04c43a7bf701eff348112 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
*** Check failure stack trace: ***
*** Check failure stack trace: ***
*** Aborted at 1781877372 (unix time) try "date -d @1781877372" if you are using GNU date ***
F20260619 13:56:12.874541 1412 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b08623aacbde40ed8d75707540765476 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874605 1406 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_387aecac34f04c43a7bf701eff348112 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874781 1407 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_04077192a2444da49f04c39c741733bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
*** Check failure stack trace: ***
F20260619 13:56:12.874541 1412 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b08623aacbde40ed8d75707540765476 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874605 1406 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_387aecac34f04c43a7bf701eff348112 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874781 1407 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_04077192a2444da49f04c39c741733bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
*** Check failure stack trace: ***
F20260619 13:56:12.874541 1412 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b08623aacbde40ed8d75707540765476 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874605 1406 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_387aecac34f04c43a7bf701eff348112 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874781 1407 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_04077192a2444da49f04c39c741733bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874577 1416 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
*** Check failure stack trace: ***
F20260619 13:56:12.874541 1412 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b08623aacbde40ed8d75707540765476 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874605 1406 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_387aecac34f04c43a7bf701eff348112 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874781 1407 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_04077192a2444da49f04c39c741733bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874577 1416 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.875777 1415 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
*** Check failure stack trace: ***
F20260619 13:56:12.874541 1412 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b08623aacbde40ed8d75707540765476 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874605 1406 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_387aecac34f04c43a7bf701eff348112 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874781 1407 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_04077192a2444da49f04c39c741733bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874577 1416 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.875777 1415 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876291 1421 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
*** Check failure stack trace: ***
F20260619 13:56:12.874541 1412 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b08623aacbde40ed8d75707540765476 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874605 1406 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_387aecac34f04c43a7bf701eff348112 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874781 1407 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_04077192a2444da49f04c39c741733bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874577 1416 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.875777 1415 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876291 1421 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876345 1409 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6b5ec95d9cfd4a979c14eac5784df343 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
*** Check failure stack trace: ***
F20260619 13:56:12.874541 1412 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b08623aacbde40ed8d75707540765476 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874605 1406 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_387aecac34f04c43a7bf701eff348112 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874781 1407 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_04077192a2444da49f04c39c741733bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874577 1416 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.875777 1415 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876291 1421 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876345 1409 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6b5ec95d9cfd4a979c14eac5784df343 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876392 1427 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
*** Check failure stack trace: ***
F20260619 13:56:12.874541 1412 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b08623aacbde40ed8d75707540765476 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874605 1406 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_387aecac34f04c43a7bf701eff348112 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874781 1407 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_04077192a2444da49f04c39c741733bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874577 1416 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.875777 1415 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876291 1421 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876345 1409 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6b5ec95d9cfd4a979c14eac5784df343 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876392 1427 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876590 1405 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a99ce2d337bd4e478e3c1723e2a85c8a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
*** Check failure stack trace: ***
F20260619 13:56:12.874541 1412 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b08623aacbde40ed8d75707540765476 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874605 1406 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_387aecac34f04c43a7bf701eff348112 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874781 1407 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_04077192a2444da49f04c39c741733bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874577 1416 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.875777 1415 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876291 1421 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876345 1409 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6b5ec95d9cfd4a979c14eac5784df343 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876392 1427 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876590 1405 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a99ce2d337bd4e478e3c1723e2a85c8a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876614 1417 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
*** Check failure stack trace: ***
F20260619 13:56:12.874541 1412 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b08623aacbde40ed8d75707540765476 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874605 1406 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_387aecac34f04c43a7bf701eff348112 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874781 1407 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_04077192a2444da49f04c39c741733bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874577 1416 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.875777 1415 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876291 1421 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876345 1409 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6b5ec95d9cfd4a979c14eac5784df343 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876392 1427 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876590 1405 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a99ce2d337bd4e478e3c1723e2a85c8a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876614 1417 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876709 1403 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_59c8023d6dec4ca985120f5dbf942dc8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
*** Check failure stack trace: ***
F20260619 13:56:12.874541 1412 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b08623aacbde40ed8d75707540765476 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874605 1406 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_387aecac34f04c43a7bf701eff348112 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874781 1407 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_04077192a2444da49f04c39c741733bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874577 1416 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.875777 1415 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876291 1421 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876345 1409 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6b5ec95d9cfd4a979c14eac5784df343 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876392 1427 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876590 1405 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a99ce2d337bd4e478e3c1723e2a85c8a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876614 1417 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876709 1403 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_59c8023d6dec4ca985120f5dbf942dc8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877825 1413 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
*** Check failure stack trace: ***
F20260619 13:56:12.874541 1412 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b08623aacbde40ed8d75707540765476 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874605 1406 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_387aecac34f04c43a7bf701eff348112 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874781 1407 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_04077192a2444da49f04c39c741733bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874577 1416 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.875777 1415 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876291 1421 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876345 1409 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6b5ec95d9cfd4a979c14eac5784df343 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876392 1427 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876590 1405 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a99ce2d337bd4e478e3c1723e2a85c8a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876614 1417 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876709 1403 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_59c8023d6dec4ca985120f5dbf942dc8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877825 1413 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877862 1423 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
*** Check failure stack trace: ***
F20260619 13:56:12.874541 1412 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b08623aacbde40ed8d75707540765476 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874605 1406 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_387aecac34f04c43a7bf701eff348112 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874781 1407 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_04077192a2444da49f04c39c741733bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874577 1416 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.875777 1415 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876291 1421 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876345 1409 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6b5ec95d9cfd4a979c14eac5784df343 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876392 1427 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876590 1405 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a99ce2d337bd4e478e3c1723e2a85c8a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876614 1417 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876709 1403 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_59c8023d6dec4ca985120f5dbf942dc8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877825 1413 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877862 1423 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877991 1404 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0a1998b5c2b34b7ab34528ad19b3cf84 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
*** Check failure stack trace: ***
F20260619 13:56:12.874541 1412 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b08623aacbde40ed8d75707540765476 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874605 1406 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_387aecac34f04c43a7bf701eff348112 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874781 1407 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_04077192a2444da49f04c39c741733bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874577 1416 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.875777 1415 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876291 1421 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876345 1409 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6b5ec95d9cfd4a979c14eac5784df343 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876392 1427 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876590 1405 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a99ce2d337bd4e478e3c1723e2a85c8a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876614 1417 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876709 1403 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_59c8023d6dec4ca985120f5dbf942dc8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877825 1413 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877862 1423 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877991 1404 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0a1998b5c2b34b7ab34528ad19b3cf84 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.878075 1420 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
*** Check failure stack trace: ***
F20260619 13:56:12.874541 1412 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b08623aacbde40ed8d75707540765476 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874605 1406 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_387aecac34f04c43a7bf701eff348112 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874781 1407 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_04077192a2444da49f04c39c741733bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874577 1416 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.875777 1415 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876291 1421 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876345 1409 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6b5ec95d9cfd4a979c14eac5784df343 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876392 1427 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876590 1405 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a99ce2d337bd4e478e3c1723e2a85c8a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876614 1417 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876709 1403 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_59c8023d6dec4ca985120f5dbf942dc8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877825 1413 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877862 1423 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877991 1404 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0a1998b5c2b34b7ab34528ad19b3cf84 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.878075 1420 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.878222 1418 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
*** Check failure stack trace: ***
F20260619 13:56:12.874541 1412 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b08623aacbde40ed8d75707540765476 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874605 1406 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_387aecac34f04c43a7bf701eff348112 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874781 1407 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_04077192a2444da49f04c39c741733bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874577 1416 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.875777 1415 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876291 1421 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876345 1409 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6b5ec95d9cfd4a979c14eac5784df343 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876392 1427 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876590 1405 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a99ce2d337bd4e478e3c1723e2a85c8a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876614 1417 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876709 1403 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_59c8023d6dec4ca985120f5dbf942dc8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877825 1413 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877862 1423 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877991 1404 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0a1998b5c2b34b7ab34528ad19b3cf84 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.878075 1420 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.878222 1418 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.878269 1429 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
*** Check failure stack trace: ***
F20260619 13:56:12.874541 1412 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b08623aacbde40ed8d75707540765476 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874605 1406 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_387aecac34f04c43a7bf701eff348112 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874781 1407 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_04077192a2444da49f04c39c741733bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874577 1416 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.875777 1415 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876291 1421 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876345 1409 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6b5ec95d9cfd4a979c14eac5784df343 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876392 1427 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876590 1405 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a99ce2d337bd4e478e3c1723e2a85c8a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876614 1417 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876709 1403 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_59c8023d6dec4ca985120f5dbf942dc8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877825 1413 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877862 1423 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877991 1404 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0a1998b5c2b34b7ab34528ad19b3cf84 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.878075 1420 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.878222 1418 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.878269 1429 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.880501 1414 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
*** Check failure stack trace: ***
F20260619 13:56:12.874541 1412 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b08623aacbde40ed8d75707540765476 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874605 1406 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_387aecac34f04c43a7bf701eff348112 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874781 1407 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_04077192a2444da49f04c39c741733bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874577 1416 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.875777 1415 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876291 1421 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876345 1409 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6b5ec95d9cfd4a979c14eac5784df343 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876392 1427 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876590 1405 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a99ce2d337bd4e478e3c1723e2a85c8a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876614 1417 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876709 1403 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_59c8023d6dec4ca985120f5dbf942dc8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877825 1413 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877862 1423 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877991 1404 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0a1998b5c2b34b7ab34528ad19b3cf84 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.878075 1420 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.878222 1418 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.878269 1429 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.880501 1414 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.880545 1411 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_80df4ccadd5348ba8e554c5123f21f78 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e8000001a5) received by PID 421 (TID 0x7fe695c16700) from PID 421; stack trace: ***
F20260619 13:56:12.874541 1412 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b08623aacbde40ed8d75707540765476 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874605 1406 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_387aecac34f04c43a7bf701eff348112 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874781 1407 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_04077192a2444da49f04c39c741733bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874577 1416 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.875777 1415 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876291 1421 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876345 1409 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6b5ec95d9cfd4a979c14eac5784df343 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876392 1427 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876590 1405 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a99ce2d337bd4e478e3c1723e2a85c8a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876614 1417 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876709 1403 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_59c8023d6dec4ca985120f5dbf942dc8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877825 1413 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877862 1423 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877991 1404 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0a1998b5c2b34b7ab34528ad19b3cf84 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.878075 1420 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.878222 1418 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.878269 1429 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.880501 1414 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.880545 1411 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_80df4ccadd5348ba8e554c5123f21f78 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.882805 1428 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
*** Check failure stack trace: ***
F20260619 13:56:12.874541 1412 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b08623aacbde40ed8d75707540765476 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874605 1406 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_387aecac34f04c43a7bf701eff348112 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874781 1407 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_04077192a2444da49f04c39c741733bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874577 1416 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.875777 1415 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876291 1421 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876345 1409 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6b5ec95d9cfd4a979c14eac5784df343 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876392 1427 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876590 1405 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a99ce2d337bd4e478e3c1723e2a85c8a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876614 1417 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876709 1403 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_59c8023d6dec4ca985120f5dbf942dc8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877825 1413 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877862 1423 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877991 1404 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0a1998b5c2b34b7ab34528ad19b3cf84 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.878075 1420 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.878222 1418 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.878269 1429 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.880501 1414 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.880545 1411 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_80df4ccadd5348ba8e554c5123f21f78 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.882805 1428 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.882817 1410 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_93c2826cde41498d8b9d82f106824c41 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
*** Check failure stack trace: ***
F20260619 13:56:12.874541 1412 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b08623aacbde40ed8d75707540765476 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874605 1406 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_387aecac34f04c43a7bf701eff348112 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874781 1407 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_04077192a2444da49f04c39c741733bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874577 1416 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.875777 1415 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876291 1421 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876345 1409 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6b5ec95d9cfd4a979c14eac5784df343 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876392 1427 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876590 1405 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a99ce2d337bd4e478e3c1723e2a85c8a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876614 1417 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876709 1403 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_59c8023d6dec4ca985120f5dbf942dc8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877825 1413 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877862 1423 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877991 1404 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0a1998b5c2b34b7ab34528ad19b3cf84 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.878075 1420 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.878222 1418 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.878269 1429 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.880501 1414 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.880545 1411 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_80df4ccadd5348ba8e554c5123f21f78 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.882805 1428 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.882817 1410 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_93c2826cde41498d8b9d82f106824c41 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.883003 1408 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8c43993fce7349e49137eb5cb7ed4fc7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
*** Check failure stack trace: ***
F20260619 13:56:12.874541 1412 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_b08623aacbde40ed8d75707540765476 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874605 1406 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_387aecac34f04c43a7bf701eff348112 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874781 1407 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_04077192a2444da49f04c39c741733bc on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.874577 1416 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.875777 1415 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876291 1421 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876345 1409 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6b5ec95d9cfd4a979c14eac5784df343 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876392 1427 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876590 1405 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a99ce2d337bd4e478e3c1723e2a85c8a on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876614 1417 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.876709 1403 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_59c8023d6dec4ca985120f5dbf942dc8 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877825 1413 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877862 1423 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.877991 1404 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_0a1998b5c2b34b7ab34528ad19b3cf84 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.878075 1420 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.878222 1418 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.878269 1429 master-stress-test.cc:393] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.880501 1414 master-stress-test.cc:330] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.880545 1411 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_80df4ccadd5348ba8e554c5123f21f78 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.882805 1428 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.882817 1410 master-stress-test.cc:353] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_93c2826cde41498d8b9d82f106824c41 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.883003 1408 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_8c43993fce7349e49137eb5cb7ed4fc7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)F20260619 13:56:12.882937 1419 master-stress-test.cc:299] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 771) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.0.105.126:34929,127.0.105.125:37003,127.0.105.124:40279, num_attempts: 1)
*** Check failure stack trace: ***
@ 0x7fe6b3098980 (unknown) at ??:0
@ 0x7fe6abe6be87 gsignal at ??:0
@ 0x7fe6abe6d7f1 abort at ??:0
@ 0x7fe6aebb3dcd google::LogMessage::Fail() at ??:0
@ 0x7fe6aebb7b93 google::LogMessage::SendToLog() at ??:0
@ 0x7fe6aebb37cc google::LogMessage::Flush() at ??:0
@ 0x7fe6aebb4f59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x40e275 kudu::MasterStressTest::ReplaceTabletThread() at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/master-stress-test.cc:393
@ 0x44b804 std::__invoke_impl<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:73
@ 0x44b6bd std::__invoke<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:95
@ 0x44b67a _ZNSt6thread8_InvokerISt5tupleIJMN4kudu16MasterStressTestEFvvEPNS2_26MasterStressTest_Test_TestEEEE9_M_invokeIJLm0ELm1EEEEDTclsr3stdE8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:234
@ 0x44b62e std::thread::_Invoker<>::operator()() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:243
@ 0x44b369 std::thread::_State_impl<>::_M_run() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:186
@ 0x7fe6ac4f56df (unknown) at ??:0
@ 0x7fe6b308d6db start_thread at ??:0
@ 0x7fe6abf4e61f clone at ??:0